Job Description

Skill:

Azure Databricks

Experience:

4 to 9 years

Location: AIA Chennai

Job Summary

We are seeking a Sr. Developer with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Delta Lake Workflows and PySpark. This role involves working in a hybrid model during day shifts focusing on developing and optimizing data solutions. Experience in Research and Development Manufacturing or Supply Chain is a plus.

Responsibilities

Develop and optimize data solutions using Databricks SQL to enhance data processing capabilities. Implement and manage Databricks Delta Lake to ensure efficient data storage and retrieval. Design and automate workflows using Databricks Workflows to streamline data operations. Utilize PySpark to process large datasets and improve data analysis efficiency. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing and validation processes. Provide technical support and troubleshooting for data-related issues. Stay updated with the latest advancements in Databricks and related technologies. Contribute to the continuous improvement of data architecture and infrastructure. Document processes and solutions to maintain a comprehensive knowledge base. Engage in code reviews to ensure best practices and coding standards are followed. Work closely with stakeholders to align data solutions with business objectives. Participate in team meetings and contribute to project planning and execution.

Qualifications

Possess strong expertise in Databricks SQL Delta Lake and Workflows. Demonstrate proficiency in PySpark for data processing tasks. Experience in Research and Development Manufacturing or Supply Chain is advantageous. Exhibit excellent problem-solving skills and attention to detail. Show ability to work collaboratively in a hybrid work model. Display strong communication skills to interact with team members and stakeholders.

Certifications Required

Databricks Certified Data Engineer Associate