Job Description

Skill:

Azure Databricks+ Pyspark

Experience:

4 to 12 years

Location: AIA Gurgaon

Job Summary

We are seeking a Sr. Developer with 5 to 9 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. This role involves developing and optimizing data solutions that drive business insights and efficiency. The position requires a proactive approach to problem-solving and a commitment to delivering high-quality results.

Responsibilities

Develop and implement data solutions using Databricks SQL to enhance business intelligence capabilities. Optimize data workflows and processes with Databricks Workflows to ensure efficient data management. Utilize Databricks Delta Lake to manage and process large datasets effectively. Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. Provide technical expertise in PySpark to develop scalable data processing applications. Ensure data integrity and security by implementing best practices in data management. Troubleshoot and resolve data-related issues to maintain system reliability and performance. Document data processes and solutions to facilitate knowledge sharing and team collaboration. Participate in code reviews and provide constructive feedback to improve code quality. Stay updated with the latest industry trends and technologies to continuously improve data solutions. Contribute to the development of data architecture and design to support business growth. Engage in continuous learning and professional development to enhance technical skills. Support the team in achieving project milestones and deliverables on time.

Qualifications

Possess strong experience in Databricks SQL for data analysis and reporting. Demonstrate proficiency in Databricks Delta Lake for efficient data storage and retrieval. Have hands-on experience with Databricks Workflows for automating data processes. Exhibit expertise in PySpark for developing robust data processing applications. Show a solid understanding of data management principles and best practices. Display excellent problem-solving skills and attention to detail. Communicate effectively with team members and stakeholders to achieve project goals.

Certifications Required

Databricks Certified Data Engineer Associate