Job Description

Skill: Azure Databricks

Experience:

9 to 12 years

Location: AIA-Gurgaon

Job Summary

As a Sr. Developer you will leverage your expertise in Databricks PySpark and AWS to drive innovative solutions in a hybrid work model. With 6 to 10 years of experience you will collaborate with cross-functional teams to enhance data processing capabilities and contribute to the companys mission of delivering impactful technology solutions.

Responsibilities

Develop and implement data processing solutions using Databricks and PySpark to optimize data workflows and improve efficiency. Collaborate with data engineers and analysts to design scalable data architectures on AWS ensuring seamless integration and performance. Analyze complex data sets to identify trends and insights that drive strategic decision-making and business growth. Provide technical guidance and support to team members fostering a collaborative and innovative work environment. Ensure data quality and integrity by implementing robust data validation and cleansing processes. Optimize existing data pipelines and workflows to enhance performance and reduce processing time. Conduct code reviews and provide constructive feedback to maintain high coding standards and best practices. Stay updated with the latest industry trends and technologies to continuously improve data processing capabilities. Participate in agile development processes contributing to sprint planning retrospectives and daily stand-ups. Troubleshoot and resolve technical issues related to data processing and AWS infrastructure. Document technical specifications and processes to ensure knowledge sharing and continuity. Engage with stakeholders to understand business requirements and translate them into technical solutions. Contribute to the companys purpose by developing data-driven solutions that have a positive impact on society.

Qualifications

Possess strong experience in Databricks and PySpark with a proven track record of successful project implementations. Demonstrate expertise in AWS services particularly in data processing and storage solutions. Exhibit excellent problem-solving skills and the ability to analyze complex data sets. Have a solid understanding of data architecture and design principles. Show proficiency in agile development methodologies and practices. Display strong communication skills to effectively collaborate with cross-functional teams.

Certifications Required

AWS Certified Solutions Architect Databricks Certified Associate Developer for Apache Spark