Job Description

Need to be Databricks SME *

Location - offshore ( Anywhere from India - Remote ) - Need to work in EST Time (US shift)

Need 12+ Years of experience.

5 Must Haves:

1. Data Expertise -- worked in Azure Data Bricks/Pipeline/ Shut Down Clusters--2 or more years' experience

2. Unity Catalog migration -- well versed--done tera form scripting in Dev Ops--coding & understand the code--understanding the logics of the behind the scenes--automate functionality

3. Tera Form Expertise -- code building --- 3 or more years

4. Understanding data mesh architecture -- decoupling applications -- ability to have things run in Parallel -- clear understanding -- 2 plus years of experience Microsoft Azure Cloud Platform

5. Great problem Solver

Key Responsibilities:

Architect, configure, & optimize Databricks Pipelines for large-scale data processing within an Azure Data Lakehouse environment. Set up & manage Azure infrastructure components including Databricks Workspaces, Azure Containers (AKS/ACI), Storage Accounts, & Networking. Design & implement a monitoring & observability framework using tools like Azure Monitor, Log Analytics, & Prometheus / Grafana. Collaborate with platform & data engineering teams to enable microservices-based architecture for scalable & modular data solutions. Drive automation & CI / CD practices using Terraform, ARM templates, & GitHub Actions/Azure DevOps.

Required Skills & Experience:

Strong hands - on experience with Azure Databricks, Delta Lake, & Apache Spark. Deep understanding of Azure services: Resource Manager, AKS, ACR, Key Vault, & Networking. Proven experience in microservices architecture & container orchestration. Expertise in infrastructure-as-code, scripting (Python, Bash), & DevOps tooling. Familiarity with data governance, security, & cost optimization in cloud environments.

Bonus:

Experience with event - driven architectures (Kafka / Event Grid). Knowledge of data mesh principles & distributed data ownership.

Interview: Two rounds of interviews (1st with manager & 2nd with the team)

Job Type: Full-time

Pay: ?3,400,000.00 - ?4,500,000.00 per year

Schedule:

* US shift