Python Airflow

Year    TN, IN, India

Job Description

Python Airflow


WorkMode : work from office

Work Location : Chennai / Hyderabad / Bangalore

Work Timing : 2 PM to 11 PM

Primary :

Python Airflow


===============================================================================================================================================================================



Years of Experience:

7-10 Years


Job Summary:

We are seeking an experienced Data Engineer with 6-9 years of overall experience, including at least 3 years working with AWS Airflow, to join our offshore teams. In this role, you will be instrumental in building and maintaining data pipelines that drive business insights and decision-making. You will collaborate closely with stakeholders to ensure data reliability, scalability, and availability for analytics and applications, helping the organization unlock the full value of its data assets.


Responsibilities:




Design, build, and maintain robust data pipelines to support analytics and business operations. Collaborate with business and technical teams to understand data requirements and deliver effective solutions. Ensure data quality, consistency, and availability across multiple systems and environments. Monitor, troubleshoot, and optimize data workflows to maintain high performance and reliability. Support data governance initiatives by implementing standards for data management and security. Participate in planning and execution of data migration, integration, and transformation projects. Document processes and workflows to enable reproducibility and knowledge sharing across teams. Provide ongoing support for production data systems, ensuring minimal downtime and quick resolution of issues. AWS Airflow (workflow orchestration, DAG design, scheduling, monitoring) - Advanced (3+ years hands-on) AWS Cloud Services (S3, Lambda, Glue, Redshift, IAM) - Advanced Data Engineering Fundamentals (ETL, data pipelines, batch/stream processing) - Expert SQL (query optimization, joins, transformations) - Advanced Python (data manipulation, scripting, automation) - Advanced Data Governance & Security

Preferred Skills:




Communication & Collaboration Performance Optimization Documentation & Knowledge Sharing Problem Solving & Troubleshooting

Qualifications:

Bachelor's degree in Computer Science, Engineering, or a related field.

About Virtusa




Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth -- one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.


Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.


Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD5065361
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    TN, IN, India
  • Education
    Not mentioned
  • Experience
    Year