Job Description

Job Summary

The Sr. Developer role is pivotal in driving the success of our data-driven projects. With a focus on Big Data and AWS technologies the candidate will design and implement scalable solutions. This hybrid role requires expertise in Apache Spark and Python ensuring efficient data processing and storage. The position offers a dynamic work environment with a day shift schedule contributing significantly to our companys innovation and impact.

Responsibilities

Develop and implement scalable data processing solutions using Big Data technologies to enhance data-driven decision-making. Collaborate with cross-functional teams to design and optimize data architectures on AWS EC2 and AWS EMR platforms. Utilize Amazon S3 for efficient data storage and retrieval ensuring data integrity and accessibility. Leverage Apache Spark to process large datasets improving data analysis and reporting capabilities. Write and maintain Python scripts for data manipulation and automation streamlining workflows and increasing productivity. Monitor and troubleshoot data pipelines to ensure seamless data flow and minimize downtime. Conduct code reviews and provide constructive feedback to peers fostering a culture of continuous improvement. Stay updated with the latest industry trends and technologies to propose innovative solutions and maintain a competitive edge. Ensure compliance with data security and privacy regulations safeguarding sensitive information. Document technical specifications and processes to facilitate knowledge sharing and onboarding of new team members. Participate in agile development processes contributing to sprint planning and retrospective meetings. Provide technical guidance and mentorship to junior developers enhancing team capabilities and performance. Collaborate with stakeholders to gather requirements and translate them into technical specifications aligning with business objectives.

Qualifications

Possess a strong background in Big Data technologies with hands-on experience in AWS EC2 and AWS EMR. Demonstrate proficiency in Amazon S3 for data storage solutions. Have extensive experience with Apache Spark for data processing tasks. Exhibit advanced skills in Python programming for data manipulation and automation. Show a proven track record of developing scalable data processing solutions. Display excellent problem-solving abilities and attention to detail. Have a solid understanding of data security and privacy regulations.

Certifications Required

AWS Certified Big Data - Specialty Apache Spark Developer Certification