Job Description

Skill:

AWS Glue

Experience:

9 to 12 years

Location: AIA Chennai

, AIA Bangalore

Job Summary

Join our dynamic team as an Architect where you will leverage your expertise in Spark Optimization AWS DevOps and Python to design and implement cutting-edge solutions. With a focus on AWS Glue Studio AWS Glue ETL and Amazon S3 you will drive innovation and efficiency in our hybrid work model. This role requires a minimum of 7 years of experience offering an exciting opportunity to make a significant impact.

Responsibilities

Design and implement scalable data architectures using Spark Optimization to enhance performance and efficiency. Collaborate with cross-functional teams to integrate AWS DevOps practices ensuring seamless deployment and operation of applications. Develop and maintain Python scripts to automate data processing tasks improving workflow efficiency. Utilize AWS Glue Studio to create and manage ETL processes ensuring data is transformed and loaded accurately. Oversee the management of data storage solutions using Amazon S3 ensuring data integrity and accessibility. Optimize Apache Spark applications to improve processing speed and resource utilization. Provide technical guidance and support to team members fostering a collaborative and innovative work environment. Conduct regular performance assessments of data systems identifying areas for improvement and implementing solutions. Ensure compliance with industry standards and best practices in data management and security. Collaborate with stakeholders to understand business requirements and translate them into technical solutions. Monitor and troubleshoot data pipelines ensuring timely resolution of any issues that arise. Stay updated with the latest advancements in cloud technologies and data engineering practices. Contribute to the continuous improvement of processes and tools enhancing overall team productivity.

Qualifications

Possess a strong background in Spark Optimization and AWS DevOps with proven experience in implementing these technologies. Demonstrate proficiency in Python programming with a focus on data processing and automation. Experience with AWS Glue Studio and AWS Glue ETL is essential for managing complex data transformations. Familiarity with Amazon S3 and Apache Spark is required to effectively manage data storage and processing. Strong problem-solving skills and the ability to work collaboratively in a hybrid work environment. Excellent communication skills to effectively convey technical concepts to non-technical stakeholders.

Certifications Required

AWS Certified Solutions Architect AWS Certified DevOps Engineer