Job Description

5 - 9 Years
7 Openings
Pune, Trivandrum

Role description

enior Data Engineer (Azure/Databricks)

Overview

We are seeking a

Senior Data Engineer

with

5+ years of hands-on experience

in building and scaling data solutions within the

Azure ecosystem

. The ideal candidate will have deep expertise in

Databricks

,

PySpark

, and

modern data lake architectures

, and be adept at designing robust

ETL pipelines

and data workflows.

Key Responsibilities

Design, develop, and maintain

scalable data pipelines

using

Azure

and

Databricks

. Build efficient

data ingestion

and

transformation

workflows with

PySpark

and

Delta Lake

. Develop, optimize, and maintain

ETL/ELT pipelines

using

Python

and

SQL

. Implement

data modeling

,

data quality

, and

governance

best practices. Work with

relational databases

(e.g., PostgreSQL) and

lakehouse architectures

(e.g., Delta Lake). Collaborate with cross-functional teams to

troubleshoot, optimize, and support

production workloads.

Required Skills & Experience

5+ years

of data engineering experience. Strong proficiency in the

Azure ecosystem

, including: +

Azure Databricks

+

Azure Data Lake Storage (ADLS)

+

Azure Functions

+

Azure Data Factory

(preferred)

Advanced PySpark

and

SQL

expertise, including performance tuning. Deep understanding of

ETL/ELT design patterns

and

data warehousing concepts

. Experience with

Delta Lake

(ACID transactions, schema evolution, time travel). Hands-on experience with

PostgreSQL

or similar RDBMS. Strong analytical, problem-solving, and communication skills. Self-motivated and comfortable in

fast-paced

, agile environments.

Preferred Skills

Familiarity with

CI/CD

pipelines (Azure DevOps, Git). Knowledge of

Infrastructure-as-Code

tools (Terraform). Exposure to

real-time streaming

technologies (Kafka, Event Hub). Awareness of

data governance

tools (e.g., Microsoft Purview).

Technical Stack

Languages & Tools:

Python, PySpark, SQL

Platforms:

Azure Databricks, ADLS, Azure Functions, ADF

Databases:

PostgreSQL, Delta Lake

DevOps & Governance:

Azure DevOps, Git, Terraform, Purview



Would you like me to turn this into a

forma

Skills

Python,Spark,Azure

About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world's best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients' organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact--touching billions of lives in the process.