Job Description

Job Title : Senior Data Engineer
Experience : 7-12 Years
Location : Bengaluru
Shift Time : 8:00am to 5:00pm or 1.30pm to 10.30pm
Roles & Responsibilities:

• Design and maintain scalable, automated data pipelines and ETL processes on Microsoft Azure.

• Oversee data infrastructure to ensure performance, resiliency, and operational efficiency.

• Collaborate with data science, analytics, and architecture teams to deliver high-quality data solutions.

• Optimize data workflows for speed, reliability, and scalability.

• Ensure data quality using validation frameworks and best practices.

• Create and maintain documentation for data processes and configurations.

• Troubleshoot and resolve data pipeline issues promptly.

• Stay updated with new technologies and implement improvements.

• Manage CI/CD processes for deploying and maintaining data solutions.

• Guide and mentor junior data engineers.

Requisites:

• Strong knowledge of Azure Data Engineering tools (ADF, Synapse, Databricks, Fabric, Data Lake, Blob).

• Proficiency in SQL and working with modern RDBMS.

• Solid understanding of software engineering fundamentals (CI/CD, testing, version control).

• Experience with big data technologies like Spark.

• Strong problem-solving, analytical, and communication skills.

• Preferred: Python/Scala/Java, PySpark, modern file formats (Parquet, Delta, Avro), API integrations, Git, Azure DevOps, Ansible.

Skills Required