, you will be a part of our data engineering team responsible for deploying, monitoring, and supporting the data mart platform. In addition, you will be responsible for creating tools and automating operational tasks to integrate the data platform with external systems. This position will participate in a 24x7 on-call rotation to ensure platform uptime.
Your entrepreneurial mindset and technical skills will be used, creating solutions that meet business needs and optimize customer experience directly impacting the organization and affecting the lives of millions.
We believe that when people from diverse cultures, genders, and points of view come together, innovation is the result --and everyone wins. Our Client walks the walk, creating an inclusive culture where you can thrive.
A DAY IN THE LIFE:
In general, the following responsibilities apply for the
Principal Software/Data Engineer
role. This includes, but is not limited to the following:
Work independently under no/limited supervision Implement CI/CD patterns for deploying and administering the data platform Setup proactive monitoring and alerting Create automation to enable a self-service model for developers Troubleshoot production issues Use platform metrics to provide guidance on right-sizing infrastructure Work with IT and business partners to identify opportunities to improve existing processes Mentor and guide junior engineers
Qualifications-
MUST HAVE - MINIMUM REQUIREMENTS:
TO BE CONSIDERED FOR THIS ROLE, PLEASE BE SURE THE MINIMUM REQUIREMENTS ARE EVIDENT ON YOUR RESUME
Bachelor's degree in Computer Engineering, Software Engineering, Computer Science, Electrical Engineering, or related technical field.
Minimum of 10 years of relevant experience in Data Engineering, or advanced degree with 7 years of relevant experience in Data Engineering.
Strong problem-solving skills Experience automating routine tasks Strong written and verbal communication & presentation skills Technical leadership experience Ability to take business requirements and work independently to deliver solutions using industry best-practice Strong security and data-privacy mindset
Core Python
experience (Mandatory) Hands-on Experience using
PySpark
and other Bigdata Technologies like HDFS, Hive, etc. Hands-on experience using Job Orchestration tools Preferably Airflow. Strong Expertise in writing SQL Queries. 2 - 4 yrs of experience in AWS and AWS native tools
S3, Glue, Lambda, EMR , Athena, Step Functions and
other AWS Services Performance Tuning of Data pipeline Jobs Mentoring Junior Developers within the team. Spearheading internal and cross-functional initiatives. Source Control systems
Git/GitHub
experience Working knowledge on container technologies like
Docker, Docker-compose
and
Kubernetes
Ability to thrive in dynamic environments Working experience in
CI/CD
process and tools like
Azure DevOps
Nice to Have
AWS certifications - AWS Certified Solution Architect / AWS Certified Data Engineer Working Knowledge on
IaC
tools like
Terraform
Previous Healthcare industry experience Participation in Org / External Initiatives like Hackathons, Abstract/White Paper Submissions
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.