Job Description

Skill:

Azure Databricks

Experience:

6 to 9 years

Location: AIA Kochi

Job Summary

We are looking for a Sr. Developer with 6 to 9 years of experience to join our team. The ideal candidate will have strong expertise in PySpark and Databricks and will work from our office during day shifts. This role does not require travel. The Sr. Developer will contribute to the development and optimization of our data processing systems ensuring efficient and reliable data workflows.

Responsibilities

Develop and maintain scalable data processing systems using PySpark and Databricks Collaborate with data engineers and analysts to design and implement data pipelines Optimize and troubleshoot existing data workflows to improve performance and reliability Ensure data quality and integrity throughout the data processing lifecycle Provide technical guidance and support to team members on PySpark and Databricks best practices Participate in code reviews to ensure code quality and adherence to standards Work closely with stakeholders to understand data requirements and deliver solutions that meet business needs Implement data security and compliance measures to protect sensitive information Monitor and manage data processing jobs to ensure timely and accurate data delivery Stay up-to-date with the latest industry trends and technologies in data processing and analytics Contribute to the continuous improvement of our data processing infrastructure and tools Document data processing workflows and procedures for future reference Collaborate with cross-functional teams to support data-driven decision making Must have strong experience with PySpark and Databricks Should have a solid understanding of data processing and ETL concepts Must possess excellent problem-solving and troubleshooting skills Should have experience with data security and compliance measures Must be able to work effectively in a collaborative team environment Should have strong communication and interpersonal skills Nice to have experience with cloud platforms such as AWS or Azure Nice to have experience with other big data technologies like Hadoop or Spark Must be detail-oriented and able to manage multiple tasks simultaneously Should have a proactive approach to learning and staying current with industry trends Must be able to work independently and take ownership of projects Should have a strong commitment to delivering high-quality work * Must have a bachelors degree in Computer Science Engineering or a related field.