Job Description

Skill:

AWS Glue

Experience:

9 to 12 years

Location: AIA Bangalore

Job Summary

Join our dynamic team as an Architect where you will leverage your expertise in Spark Optimization AWS DevOps and Python to design and implement cutting-edge solutions. With a focus on AWS Glue Studio and ETL processes you will optimize data workflows and ensure seamless integration with Amazon S3. This hybrid role offers the opportunity to work on innovative projects that drive our companys success.

Responsibilities

Design and implement scalable data architectures using Spark Optimization to enhance performance and efficiency. Collaborate with cross-functional teams to develop and deploy AWS DevOps solutions that streamline operations and improve system reliability. Utilize Python to create robust scripts and applications that automate data processing tasks and enhance productivity. Lead the development of AWS Glue Studio workflows to ensure seamless data integration and transformation processes. Optimize AWS Glue ETL jobs to improve data processing speed and accuracy contributing to overall project success. Manage and maintain data storage solutions using Amazon S3 ensuring data integrity and accessibility. Oversee the implementation of Apache Spark to process large datasets enabling data-driven decision-making. Provide technical guidance and support to team members fostering a collaborative and innovative work environment. Ensure compliance with industry standards and best practices in data architecture and cloud computing. Monitor system performance and implement improvements to enhance efficiency and reduce downtime. Collaborate with stakeholders to gather requirements and translate them into technical specifications and solutions. Conduct regular reviews and updates of data architecture to align with evolving business needs and technological advancements. Contribute to the companys mission by delivering high-quality solutions that drive innovation and impact society positively.

Qualifications

Possess a strong background in Spark Optimization and AWS DevOps with proven experience in designing scalable architectures. Demonstrate proficiency in Python programming with the ability to develop efficient scripts and applications. Have hands-on experience with AWS Glue Studio and ETL processes ensuring seamless data integration. Exhibit expertise in managing data storage solutions using Amazon S3 maintaining data integrity and accessibility. Show proficiency in Apache Spark for processing large datasets and enabling data-driven decision-making.

Certifications Required

AWS Certified Solutions Architect AWS Certified DevOps Engineer