Job Description

Skill: Azure Databricks

Experience:

4 to 6 years

Location: AIA-Gurgaon

Job Summary

We are seeking a skilled Developer with 3 to 5 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. This role involves developing and optimizing data solutions to drive business insights and efficiency. The position offers an opportunity to contribute to impactful projects that enhance our data capabilities and support our companys growth.

Responsibilities

Develop and maintain scalable data pipelines using Databricks SQL and PySpark to support business analytics and reporting needs. Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications. Optimize data workflows and processes using Databricks Delta Lake to ensure data accuracy and reliability. Implement and manage Databricks Workflows to automate data processing tasks and improve operational efficiency. Troubleshoot and resolve data-related issues ensuring minimal disruption to business operations. Provide technical guidance and support to team members on best practices for using Databricks tools. Conduct regular performance tuning and optimization of data solutions to enhance system performance. Ensure data security and compliance with company policies and industry standards. Document data processes and workflows to facilitate knowledge sharing and continuity. Stay updated with the latest developments in Databricks and related technologies to drive innovation. Contribute to the design and architecture of data solutions that align with business objectives. Participate in code reviews to maintain high-quality standards and improve team collaboration. Engage in continuous learning and professional development to enhance technical skills and knowledge.

Qualifications

Possess a strong understanding of Databricks SQL and its application in data analytics. Demonstrate proficiency in using Databricks Delta Lake for data management and optimization. Have experience with Databricks Workflows for automating data processes. Exhibit expertise in PySpark for developing and maintaining data pipelines. Show capability in troubleshooting and resolving complex data issues. Display strong communication skills for effective collaboration with cross-functional teams. Maintain a proactive approach to learning and adapting to new technologies.

Certifications Required

Databricks Certified Data Engineer Associate