Job Description

-------------------

Overview

Will lead data pipeline development end-to-end, spanning data modeling, testing, scalability, operability and ongoing metrics.We work in Python / Airflow: however, languages can be learned. We put more emphasis on your general engineering skill and willingness to learn than knowledge of a particular language or framework. This is a senior role that requires exceptional programming skills, proven technical leadership, ability to collaborate cross-functionally with business stakeholders, product managers, designers, and other technology leaders. We are looking for senior engineers with a passion for technology, researching new solutions and ways of working, who enjoy mentoring other engineers and sharing insights with their peers.

Responsibilities

Lead the ICC data engineering team . Help to attract talent to the team by networking with your peers, by representing Pepsico HBS at conferences and other events, and by discussing our values and best practices when interviewing candidates. Own data pipeline development end-to-end, spanning data modeling, testing, scalability, operability and ongoing metrics. Ensure that we build high quality software by reviewing peer code check-ins Define best practices for product development, engineering, and coding as part of a world class engineering team Work on a product team leveraging our core technology platforms, which include Direct Commerce, Supply Chain, Marketing Automation, Mobile, and Data. Collaborate in architecture discussions and architectural decision making that is part of continually improving and expanding these platforms. Lead feature development in collaboration with other engineers; validate requirements / stories, assess current system capabilities, and decompose feature requirements into engineering tasks Focus on delivering high quality data pipelines and tools through careful analysis of system capabilities and feature requests, peer reviews, test automation, and collaboration with QA engineers Develop software in short iterations to quickly add business value Introduce new tools / practices to improve data and code quality; this includes researching / sourcing 3rd party tools and libraries, as well as developing tools in-house to improve workflow and quality for all data engineers Support data pipelines developed by your team through good exception handling, monitoring, and when needed by debugging production issues

Qualifications

8+ years experience developing data pipelines / ETLs 5+ years of experience managing mid/large level size team and delegating project specific responsibility for seamless delivery Deep understanding of database design and engineering Strong familiarity with automated test frameworks Current skills in following technologies: Python + Airflow, Luigi, or similar orchestration platforms
+ Relational databases - Postgres, MySQL, or similar
+ AWS, Azure, or similar cloud platforms
+ GitHub or similar source control
+ Automated build process and tools
* Fluent with Agile processes and tools such as Jira or Pivotal Tracker; must have experience running Agile teams, continuous integration, automated testing, and test driven development