Data Engineer
Year KA, IN, India
Job Description
Design, develop, and maintain scalable
data pipelines
on Databricks usingPySpark
and Delta Lake. Build and optimize ETL/ELT workflows integratingSAP systems with Databricks
(using OData, SAP BTP, CDC tools, DB Connectors, or partner solutions). Ingest structured and unstructured data from multiple SAP and non-SAP sources into the lakehouse. Implement data modeling (Medallion architecture - Bronze/Silver/Gold). Optimize Databricks clusters, jobs, workflows, and performance tuning of PySpark workloads. Ensure data quality, governance, lineage, and compliance across all pipelines. Troubleshoot data issues, analyze performance bottlenecks, and ensure pipeline reliability. * Prepare technical documentation, deployment scripts, and reusable frameworks.
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Job Detail
-
Job IdJD4962320
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:Not mentioned
-
Employment StatusPermanent
-
Job LocationKA, IN, India
-
EducationNot mentioned
-
ExperienceYear