Job Description

Responsibilities: Main Purpose of the role:

• We are looking for a savvy Data Engineer to join our growing team of analytics experts ! The hire will be responsible for expanding and optimizing our data and data pipeline architecture. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.
• This role would include development work within the Enterprise Data Warehouse (EDW) platform on Oracle, Teradata, Azure Data Lake, Data bricks, and other related ETL technologies, with the responsibility of ensuring on time and on budget delivery, Satisfying project requirements, while adhering to enterprise architecture standards. Role will lead key projects and provide development/technical leadership to more junior resources. This is a hands-on position with a significant development component and expectation for the ideal resource is to lead the technical development and delivery of highly visible and strategic projects.

• Lead development and delivery of key data and analytics projects within time and budget.
• Drive solution design and build to ensure scalability, performance, and reuse.
• Design robust data architectures taking into account performance, data quality, and data latency requirements.
• Ability to recommend and drive consensus around preferred data integration approaches.
• Ability to anticipate data bottlenecks (latency, quality, speed) and recommend appropriate remediation strategies.
• Ensure on time and on budget delivery that satisfies project requirements, while adhering to enterprise architecture standards.
• Manage work intake, prioritization and release timing, balancing demand and available resources.
• Manage partnership with vendors.
• Lead a team of employee and contract resources to meet data engineering requirements.
• Set priorities for the team to ensure task completion.
• Coordinate work activities with other IT services and business teams.
• Hold team accountable for milestone deliverables.

• Advanced working SQL knowledge and experience working with relational databases, as well as working familiarity with a variety of databases.
• Experience building and optimizing data pipelines, architectures and data s-ets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Advanced knowledge and experience in relational databases , Data Warehousing and ETL/ELT technologies
• At least 2+ years of experience with Data Bricks, ADF (Azure Data Flow) and other cloud capabilities.
• Proficiency with Python, SQL, UNIX/LINUX scripting
• Excellent remote collaboration skills
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Hands-on experience with one or more cloud service providers (Azure preferred)
• Participated in performance Tuning, Data Analysis, Mapping, Loading & Validation
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Prior experience in working in SCALED AGILE framework
• Strong Analytical skills

• Experience in Spark, Informatica
• Experience with working with Teradata and Teradata utilities such as TPUMP, BTEQ, TPT
• Good familiarity with the Software Development Life Cycle (SDLC) and Data Ingestion

• Ability to work with virtual teams (remote work locations).
• Participate in ideation and solutioning discussions, driving clarity of complex issues/requirements to build robust solutions.
• Proficient in analyzing and translating business requirements to technical requirements and modeling the Logical and Physical Data Models.
• Should be able to work independently.