Design and implement scalable data architectures using AWS Glue Databrew and Spark Optimization to enhance data processing efficiency.
Oversee the deployment of AWS Cloud Formation templates to automate infrastructure provisioning ensuring consistency and reliability.
Provide expertise in AWS CloudWatch for monitoring and logging ensuring system performance and availability.
Optimize data storage solutions using Amazon Redshift and Amazon S3 ensuring cost-effectiveness and scalability.
Lead the development of ETL processes using AWS Glue Studio and AWS Glue ETL to streamline data integration and transformation.
Collaborate with cross-functional teams to ensure seamless integration of data solutions within the AWS cloud environment.
Conduct performance tuning and optimization of Apache Spark applications to improve processing speed and resource utilization.
Develop and maintain documentation for data architectures and processes ensuring clarity and accessibility for team members.
Evaluate and recommend new technologies and tools to enhance data processing capabilities and support business objectives.
Ensure data security and compliance with industry standards and regulations safeguarding sensitive information.
Provide technical guidance and support to team members fostering a collaborative and innovative work environment.
Analyze and resolve complex technical issues ensuring minimal disruption to data processing operations.
Contribute to the continuous improvement of data solutions aligning with the companys strategic goals and societal impact.
Qualifications
Possess strong expertise in AWS Glue Databrew Spark Optimization and related AWS services.
Demonstrate proficiency in AWS Cloud Formation AWS CloudWatch and Amazon Redshift.
Exhibit experience in AWS Glue Studio AWS Glue ETL and Amazon S3 for data integration and storage.
Have a solid understanding of Apache Spark and its optimization techniques.
Experience in the Provider domain is a plus.
Ability to work effectively in a hybrid work model with a focus on day shifts.
* Strong problem-solving skills and a proactive approach to technical challenges.
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.