Overview:
The Azure Data Engineer / Data Architect will be responsible for designing, developing, and managing scalable data solutions on Microsoft Azure. You will ensure that data is accessible, optimized for performance, and compliant with organizational and security standards. You will have hands-on expertise with Azure services, strong ETL development skills, and the ability to architect modern data platforms that support business intelligence, analytics, and advanced data science initiatives. You will operate in a Scrum/Agile environment, collaborating closely with cross-functional teams to deliver value iteratively.
Responsibilities:
Design, build, and maintain scalable and reliable data pipelines using Azure services.
Architect and implement data integration solutions to support business needs.
Develop and manage ETL processes for data ingestion, transformation, and loading.
Collaborate within cross-functional teams (data scientists, analysts, business stakeholders) in an Agile/Scrum setup.
Actively participate in sprint planning, daily stand-ups, retrospectives, and other Agile ceremonies.
Optimize pipelines for performance, reliability, and cost-efficiency.
Ensure data governance, quality, and integrity across the entire data lifecycle.
Implement and enforce data security, compliance, and privacy standards.
Document data architecture, data flows, and processes for knowledge sharing and audit readiness.
Continuously improve workflows by adopting Agile best practices and modern engineering standards.
Requirements:
Bachelor's degree in Computer Science, Information Technology, Data Engineering, or related field.
Proven experience as a Data Engineer / Data Architect with Microsoft Azure.
Strong expertise in data modeling, data warehousing, and ETL development.
Hands-on experience with Azure Data Factory, Azure Data Lake, and Azure SQL Database.
Exposure to big data and distributed processing technologies (Hadoop, Spark, Databricks).
Proficiency in programming languages such as Python and strong SQL skills.
Familiarity with Agile methodology and experience working in a Scrum team environment.
Azure Data Factory
Azure Data Lake
Azure SQL Database
ETL Development
Data Modeling & Data Warehousing
Python, SQL
Spark, Databricks
Scrum & Agile Delivery
Additional Preferred Skills:
Experience with Azure Synapse Analytics or Cosmos DB.
Knowledge of data governance frameworks (e.g., GDPR, HIPAA, or industry standards).
CI/CD integration for data pipelines (Azure DevOps, GitHub).
Familiarity with real-time data streaming tools (Event Hubs).
?Fivetran or Airbyte
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.