Job Description

: Azure Data Engineer (PySpark)

Position Overview:

We are seeking a highly skilled

Azure Data Engineer

with

5 years of professional experience

in designing, building, and optimizing data pipelines. The ideal candidate will have strong expertise in

PySpark

,

Azure Data Services

, and modern data engineering practices to support scalable analytics and business intelligence solutions.

Key Responsibilities:

Design, develop, and maintain

data pipelines

using

PySpark

and

Azure Data Factory

. Implement

ETL/ELT processes

for structured and unstructured data across multiple sources. Optimize big data workflows for

performance, scalability, and cost efficiency

. Collaborate with data scientists, analysts, and business stakeholders to deliver

clean, reliable datasets

. Manage and monitor

Azure cloud resources

including

Azure Data Lake, Synapse Analytics, Databricks, and Blob Storage

. Ensure

data quality, governance, and security compliance

across all solutions. Troubleshoot and resolve issues in

data pipelines

and provide production support. Document technical designs, workflows, and best practices for knowledge sharing.

Required Skills & Experience

5 years of experience

in

data engineering

with a focus on

PySpark

. Strong knowledge of

Azure ecosystem

: Azure Data Factory

Azure Databricks

Azure Synapse Analytics Azure Data Lake Storage Proficiency in

Python (PySpark)

for big data processing. Solid understanding of

SQL

and

data modeling

concepts. Experience with

CI/CD pipelines

and version control (Git). Knowledge of

data governance, security, and compliance frameworks

. Strong problem-solving and analytical skills.

Preferred Qualifications

Exposure to

machine learning pipelines

or

data science workflows

. Experience with

Power BI

or other visualization tools. Familiarity with

DevOps practices

in Azure. Knowledge of

streaming technologies

(Kafka, Event Hub).
Job Type: Contractual / Temporary
Contract length: 36 months

Benefits:

Health insurance Provident Fund
Work Location: In person