Lead Data Engineer

Year    Bangalore, Karnataka, India

Job Description

About Delta Air Lines
About the Company
Delta Air Lines (NYSE: DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of connecting the people and cultures of the globe, Delta strives to foster understanding across a diverse world and serve as a force for social good.
In 2024, Delta was recognized by Fortune with a No. 11 placement on Fortune's Top 50 Most Admired Companies list. The company's strong management and commitment to providing elevated experiences and premium products also secured a No. 1 ranking out of the eight airlines on the list. Delta landed on TIME's inaugural list of the "World's Best Companies," coming in at No. 12 - the only U.S. airline in the top 155. TIME's award is based on three criteria: employee satisfaction, revenue growth and sustainability.
Delta's people-first culture continues to be recognized, earning the airline a spot on Fortune's 100 Best Companies to Work For list for the fifth year. Delta is the only airline included on the 2024 list.
Additionally, Delta earned a coveted spot, on Fast Company's list of the Most Innovative Companies, climbing from its No. 8 spot in 2023 to No. 2 in the travel category. The airline was recognized for its Wi-Fi revolution that is working to ensure the future of travel is connected.
About the Delta Technology Hub (DTH), Bangalore
Delta has fast emerged as a customer-focused, innovation-led, technology-enabled business. The Delta Technology Hub will contribute directly to these objectives.

Why join?

  • Technology is a key enabler of the differentiated services that Delta provides. At the DTH, you get the opportunity to work on projects with a significant impact on business outcomes and customer experience.
  • Deepen your knowledge by taking part in multifaceted learning and development programs exposure to extensive internal and partner repositories, institutional affiliations, and industry SIG (Special Interest Groups) partnerships.
  • Collaborate with research, innovation and IP co-development partners.
  • Immerse yourself in an employee-centric culture.
  • Develop deep and broad business acumen on airline operations while retaining focus on cutting-edge technology driven solutions.
  • Avail a full range of benefits that support you and your family: Insurance, Commute, Meals, Retirement, and Special Travel opportunities.
  • Avail a full range of benefits that support you and your family: Insurance, Commute, Meals, Retirement, and special travel opportunities
How youll help us Keep Climbing (overview & key responsibilities):
Delta Air Lines is seeking an AWS Solution Engineer who will be responsible for designing, implementing, and governing our AWS cloud environment to support Deltas Marketing Operations. This role will focus on building and maintaining scalable, secure, and automated AWS solutions that enable marketing communications to Deltas customers. This role is critical to ensuring the stability, security, and performance of Deltas data infrastructure and automated jobs that power marketing communications.
Responsibilities:
Cloud Solution Design & Deployment:
  • Architect and implement AWS-based solutions to support marketing automation workflows and data pipelines.
  • Ensure deployments are reliable, scalable, and optimized for performance across production environments.
  • Collaborate with cross-functional teams to configure and deploy applications following AWS best practices.
AWS Administrative Responsibilities:
  • Manage AWS account configurations, including IAM roles, policies, and permissions to ensure secure access control.
  • Maintain compliance with organizational security standards by configuring AWS services for encryption, logging, and auditing.
  • Oversee backup and disaster recovery strategies using AWS services such as S3, Glacier, and Backup.
  • Monitor and optimize AWS resource utilization and Implement tagging strategies for resource management and cost allocation.
  • Regularly review and update AWS configurations to align with evolving business and security requirements.
AWS DevOps & Infrastructure as Code:
  • Develop and maintain Infrastructure as Code (IaC) templates using AWS CloudFormation and/or terraform.
  • Automate provisioning and deployment pipelines using AWS CodePipeline, CodeBuild, and CodeDeploy.
  • Implement CI/CD workflows for AWS-based applications and data pipelines.
  • Ensure version controlled, repeatable deployments across environments.
Technology Modernization & Migration:
  • Lead migration of legacy systems to AWS cloud-native architectures, leveraging services like Glue, Lambda, and Step Functions.
  • Drive transition from SAS/UNIX-based systems to Python/AWS frameworks for improved agility and maintainability.
Airflow Setup & Monitoring:
  • Deploy and configure Amazon MWAA (Managed Workflows for Apache Airflow) for orchestration of complex data workflows.
  • Develop DAGs (Directed Acyclic Graphs) for ETL and automation tasks ensuring modularity and scalability.
  • Monitor Airflow environments for performance, reliability, and SLA compliance using built-in Airflow tools and AWS CloudWatch.
  • Implement alerting and logging strategies for Airflow jobs to proactively detect and resolve failures.
Architecture & Infrastructure Alignment:
  • Partner with solution architects to align AWS solutions with enterprise marketing technology architecture.
  • Support integration with CDPs, journey orchestration platforms, and AI-driven marketing engines.
Data Governance & Documentation:
  • Ensure all solutions adhere to industrys best practices for version control, security, and data governance and version control within AWS environments.
  • Create and maintain comprehensive documentation of AWS architecture, data workflows, and operational processes for technical and business stakeholders.
Agile Development & Collaboration:
  • Actively participate in daily stand-ups, sprint planning, and retrospectives to deliver iterative solutions.
  • Work closely with team members to refine requirements, troubleshoot issues and optimize AWS-based solutions to meet evolving business and technical needs.
Innovation & Continuous Improvement
  • Stay abreast of industry trends, emerging tools, and best practices in AWS and marketing technology.
  • Develop proof-of-concepts and propose innovative solutions to technical and non-technical teams, driving continuous improvement in data workflows and marketing insights.
What you need to succeed (minimum qualifications):
Education:
  • Bachelors degree in computer science, Engineering, Information Systems, or a related field or an equivalent combination of education, training, and hands-on experience in computer systems engineering.
Experience:
  • 5+ years designing and implementing AWS-based solutions, including Infrastructure as Code (IaC) and automation.
  • 7+ years overall work Experience
  • Proven experience building ETL pipelines and automation workflows using AWS services.
  • Hands-on experience with AWS monitoring, security, and administrative tasks (IAM, cost optimization, compliance).
  • Background in enterprise data warehouse environments (Teradata and Amazon Redshift). Strong understanding of relational and non-relational data warehouse architectures and best practices.
Technical Skills:
Hands-on experience with AWS services, including but not limited to:
  • AWS Glue, Lambda, MWAA (Managed Workflows for Apache Airflow)
  • Amazon S3, Athena, Redshift/Teradata
  • AWS CloudFormation for Infrastructure as Code
  • AWS Code Pipeline, Code Build, Code Deploy for CI/CD
  • AWS CloudWatch, Guard Duty, Security Hub for monitoring and security
  • Proficient in Python, SQL, PySpark, and Unix shell scripting, with a focus on writing clean, maintainable, and well-documented code
Data Expertise:
  • Proven ability to work with large, complex datasets, ensuring performance and scalability.
  • Strong analytical and problem-solving skills, with a track record of delivering efficient and reliable data solutions.
Marketing Technology Exposure:
  • Familiarity with Customer Data Platforms (CDPs), real-time journey orchestration, and AI-driven marketing systems such as Adobe Experience Platform and Adobe Journey Optimizer.
  • Experience integrating AWS solutions with marketing engagement platforms (Salesforce Marketing Cloud, APIs, SFTP).
  • Communication & Collaboration:
  • Excellent verbal and written communication skills, with the ability to convey complex technical concepts to both technical and non-technical stakeholders.
Behavioral Competencies:
  • Lead initiatives with high accountability, create a collaborative environment with a solution-based approach.
  • Serve as a trusted advisor and mentor for the team offering technical advice.
  • Ability to communicate with precision, engaging team and stakeholders to build trust and reliable working relationships across cross-functional teams and geographies enabling organizational alignment.
  • Ability to set priorities with the team by understanding interdependence, inspiring team members with consistent focus, quality output, and timelines.
  • Constantly keep oneself updated on current technology & trends to drive innovative decisions through piloting forward-thinking approaches to complex problems in ones own area of work.
  • Inquisitive to understand customer priorities and business challenges while creating value for technical solutions.
What will give you a competitive edge (preferred qualifications):
  • Knowledge or related experience in the airline industry.
  • AWS Certifications.
ID: DELSN03

Skills Required

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD4921714
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bangalore, Karnataka, India
  • Education
    Not mentioned
  • Experience
    Year