Hiring Senior Azure Data engineer for PAN India
Experience - 5+ years
Required Technical Skillset - Azure, Databricks, ADF, Pyspark
Responsibilities:
Build pipelines for raw data ingestion and setting up their orchestration and schedules in environments that follow medallion architecture.
Ensure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements
Develop and maintain innovative Azure solutions, perform transformation using Databricks notebooks with Pyspark.
Able to quickly trace out the issues if any Databricks Workflows fail and know how to optimise the data load for faster processing.
Should have good knowledge on CICD process using Github and hands on experience in Airflow.
Load transformed data into storage and reporting structures in destinations including data warehouses using high speed indexes for real-time reporting systems and analytics applications
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.