Job Description

About HST Global

HST Global in Bangalore is a division of the Hy-Vee IT team named as the Helpful Smiles Technology Center based in the West Des Moines, Iowa, US. Hy-Vee IT (HST) supports Hy-Vees business growth and modernization needs by accelerating the adoption of technology across enterprise operations. Hy-Vee offers employees a unique opportunity to transform technology at Hy-Vee, understand different markets and cultural dynamics, as well as the opportunity to work locally and remotely on IT challenges. Hy-Vee IT is looking to expand its capabilities in software development and delivery with roles such as agile, fullstack, and data analysts based out of the HST Global. HST Global will serve the entire IT organization across roles and functions.



Lead Data Engineer (8 - 12 Years)

As a Lead Data Engineer, you will work to deliver large-scale, high-volume data enrichment through the business configuration of data pipelines on both on-prem and cloud (Azure, GCP) using intelligent design and scalable, robust code. You should have extensive knowledge of the industry best practices for ETL design, principles, and concepts, and experience within a test-driven environment.

Responsibilities

• Collaborating with management to understand company objectives.
• Developing algorithms and prototypes to transformdatainto useful, actionable information.
• Architecting, Designing and maintaining database pipeline architectures and getting ready for AI / ML transformations.
• Lead, Design, Create and maintain on premise and cloud-based data integration pipelines.
• Assemble large, complex data sets that meet functional/nonfunctional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
• Build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics.
• Work with business stakeholders to understand their data integration requirements and provide recommendations on best practices for data integration and processing.
• Create data pipelines to enable BI, Analytics and Data Science teams that assist them in building and optimizing their systems.
• Collaborate with other data engineers and architects to ensure data quality, consistency, and accuracy.
• Assists in the onboarding, training and development of team members.
• Reviews code changes and pull requests for standardization and best practices.
• Evolve existing development to be automated, scalable, resilient, self-serve platforms.
• Stay current with industry trends and best practices in ETL and data integration.
• Mentor and train junior ETL developers on technical skills.

• Proven advanced level of writing database programming languages (T-SQL, SQL (Mandatory), PLSQL, etc.)
• Proven advanced level of implementing multiple database platforms (OLAP, OLTP, Data Warehouse, NoSQL)
• Hands-on experience in ETL/BI/DB analysis using SQL Server, Oracle PL/SQL, Oracle DRM and Teradata
• Proven advanced level of implementing and using ETL tools like SSIS, Informatica and other ETL tools.
• Proven intermediate level of writing Python or similar programming language.
• Ingest and move data between databases that include relational and no-SQL databases like Oracle, SQL Server, MongoDB, Elastic Search, Google Bigquery, etc.
• Experience with integration of data from multiple data sources utilizing ETL tools.
• Intermediate understanding of Cloud Platforms like Azure (ADF/ SQL data warehouse) and GCP (Dataproc, Dataflow, Big Query, Compute, Pub/Sub) and Cloud Storage
• Highly knowledgeable in industry best practices for ETL Design, Principles, and Concepts
• Proficiency with source control and release technologies (e.g., Git and Azure DevOps) and practices (e.g., CI/CD and automation)
• Experience in the skills like DWH,DataLake, BI reporting, Analytics and dashboarding
• Experience with establishing SDLC andDataEngineeringbest practices.
• Experience with leading fine tuning, scaling, monitoring and alerting initiatives.

HST Global