Databricks + Pyspark

Year    TN, IN, India

Job Description

AIA - Face to Face Drive - 06 Dec 2025



Skill - AWS Data engineer



Experience- 4 to 12 Years



Location - Chennai - Face to Face



Drive Date - 06 Dec 2025



Responsibilities



Design and implement scalable data architectures using AWS Glue Databrew and Spark Optimization to enhance data processing efficiency. Oversee the deployment of AWS Cloud Formation templates to automate infrastructure provisioning ensuring consistency and reliability. Provide expertise in AWS CloudWatch for monitoring and logging ensuring system performance and availability. Optimize data storage solutions using Amazon Redshift and Amazon S3 ensuring cost-effectiveness and scalability. Lead the development of ETL processes using AWS Glue Studio and AWS Glue ETL to streamline data integration and transformation. Collaborate with cross-functional teams to ensure seamless integration of data solutions within the AWS cloud environment. Conduct performance tuning and optimization of Apache Spark applications to improve processing speed and resource utilization. Develop and maintain documentation for data architectures and processes ensuring clarity and accessibility for team members. Evaluate and recommend new technologies and tools to enhance data processing capabilities and support business objectives. Ensure data security and compliance with industry standards and regulations safeguarding sensitive information. Provide technical guidance and support to team members fostering a collaborative and innovative work environment. Analyze and resolve complex technical issues ensuring minimal disruption to data processing operations. Contribute to the continuous improvement of data solutions aligning with the companys strategic goals and societal impact.




Qualifications



Possess strong expertise in AWS Glue Databrew Spark Optimization and related AWS services. Demonstrate proficiency in AWS Cloud Formation AWS CloudWatch and Amazon Redshift. Exhibit experience in AWS Glue Studio AWS Glue ETL and Amazon S3 for data integration and storage. Have a solid understanding of Apache Spark and its optimization techniques. Experience in the Provider domain is a plus. Ability to work effectively in a hybrid work model with a focus on day shifts. * Strong problem-solving skills and a proactive approach to technical challenges.

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD4822507
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    TN, IN, India
  • Education
    Not mentioned
  • Experience
    Year