Design, develop, and manage scalable data pipelines using
Databricks (Spark, Delta Lake)
.
Optimize large-scale
data processing workflows
for performance, scalability, and reliability.
Collaborate with
Data Scientists, Analysts, and Business Stakeholders
to understand requirements and deliver actionable insights.
Ensure
data quality, integrity, and consistency
across multiple systems and data sources.
Work with
cloud data platforms (Azure, AWS, GCP)
and leverage cloud-native services.
Implement
data governance, cataloging, and lineage tracking
using tools such as
Unity Catalog, Great Expectations, or similar
.
Monitor, debug, and troubleshoot data pipelines, ensuring high availability and stability.
Contribute to best practices, coding standards, and architectural improvements for the data engineering team.
Required Qualifications
5+ years of professional experience
in Data Engineering or related roles.
Strong hands-on expertise with
Databricks, Apache Spark, and Delta Lake
.
Proficiency in
SQL, Python
, and distributed data processing concepts.
Experience with
cloud platforms (Azure/AWS/GCP)
and cloud-native tools.
Hands-on exposure to
ETL/ELT processes, data warehousing, and the modern data stack
.
Familiarity with
CI/CD pipelines, version control (Git), and agile development practices
.
Strong
analytical, problem-solving, and communication skills
.
Ability to work independently as well as in cross-functional teams.
Preferred Skills
Experience with
workflow orchestration tools
(Airflow, ADF, or similar).
Knowledge of
data lakehouse architectures
and advanced data modeling techniques.
Exposure to
containerization and deployment
(Docker, Kubernetes).
Interested candidates can share us your resume at
rahul.sharma@infoobjects.com
Job Types: Full-time, Permanent
Pay: ₹700,000.00 - ₹1,500,000.00 per year
Benefits:
Food provided
Health insurance
Life insurance
Paid sick time
Provident Fund
Work Location: In person
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.