Job Description

5 - 7 Years
2 Openings
Trivandrum

Role description

Develop, test, and maintain data pipelines using Azure Databricks, SQL etc

Design and implement ETL/ELT workflows to process large volumes of structured and unstructured data.

Work with PySpark or Scala to build and optimize transformations within Databricks notebooks.

Integrate Databricks with other Azure services (e.g., Synapse Analytics, Key Vault, and Event Hubs).

Collaborate with data architects and analysts to ensure high data quality, performance, and scalability.

Implement and monitor data validation, error handling, and performance tuning for data pipelines.

Participate in code reviews, ensure adherence to best practices, and maintain project documentation.

Assist in migrating on-premise data solutions to Azure Databricks-based architectures.

Support the implementation of CI/CD pipelines for data workflows.

Troubleshoot and resolve issues in data ingestion, transformation, and storage layers.

Skills

databricks,pyspark,sql,etl,

About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world's best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients' organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact--touching billions of lives in the process.