Databricks Tech Lead

Year    MH, IN, India

Job Description

Pune



About Us




We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization.
Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner.
Using centuries of cumulative experience, research and leadership, we help our clients eliminate the complexities & risk of legacy modernization and safely deliver big data hubs, operational data integration, business intelligence, risk & compliance solutions and traditional data warehouses & marts.
At Hoonartek, we work to ensure that our customers, partners and employees all benefit from our unstinting commitment to delivery, quality and value. Hoonartek is increasingly the choice for customers seeking a trusted partner of vision, value and integrity

How We Work?



Define, Design and Deliver (D3) is our in-house delivery philosophy. It's culled from agile and rapid methodologies and focused on 'just enough design'. We embrace this philosophy in everything we do, leading to numerous client success stories and indeed to our own success.
We embrace change, empowering and trusting our people and building long and valuable relationships with our employees, our customers and our partners. We work flexibly, even adopting traditional/waterfall methods where circumstances demand it. At Hoonartek, the focus is always on delivery and value.



Job Title: Tech Lead - Databricks (Banking & Financial Services)
Location: Pune



About the Role:

Lead technical implementation of Lakehouse architecture and ELT pipelines. Work closely with Architect and stakeholders to deliver secure, scalable solutions for banking use cases.



Experience:

8-12 years in data engineering, 3-4 years hands-on Databricks development.



Key Responsibilities:

+ Build ELT pipelines and medallion layers
+ Optimize PySpark jobs for performance and cost
+ Implement orchestration and CI/CD
+ Mentor engineers and ensure coding best practices
+ Apply governance rules and enforce RBAC/masking

Required Skills:

+ Databricks & Spark (SQL, Python), Delta Lake, Unity Catalog
+ ELT, Databricks Workflows, ADF
+ Cloud platforms (Azure preferred), streaming (Kafka/Event Hubs)

Certifications:

Databricks Associate/Professional, Azure DP-203

Job Requirement



Role Comparison Table


=========================

Aspects:



Primary FocusDefine overall Lakehouse architecture and standards (Architect) Lead technical implementation and team delivery (Tech Lead)

Experience12-18 years; 5+ years in Databricks architecture(Architect) 8-12 years; 3-4 years hands-on Databricks development (Tech Lead)

Key ResponsibilitiesDesign architecture, governance, compliance (Architect) Build ELT pipelines, optimize jobs, mentor team (Tech Lead)

Data IntegrationStrategy for multi-source integration (Architect) Hands-on ingestion and transformation (Tech Lead)

Governance & SecurityDefine policies and compliance frameworks (Architect) Apply governance rules in pipelines (Tech Lead)

Stakeholder InteractionEngage with leadership and business teams (Architect) Collaborate with architect and analysts (Tech Lead)

Technical DepthArchitecture patterns, scalability, cost optimization (Architect) Spark coding, debugging, performance tuning (Tech Lead)

Leadership RoleStrategic, sets vision and standards (Architect) Tactical, leads engineers and ensures delivery (Tech Lead)

CertificationsDatabricks Professional, Azure Architect (Architect) * Databricks Associate/Professional, Azure DP-203(Tech Lead)

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD5111284
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    MH, IN, India
  • Education
    Not mentioned
  • Experience
    Year