Job Description

5 - 7 Years
1 Opening
Trivandrum


###

Role description

Data Engineer (PySpark, Snowflake, AWS Glue)

Experience: 5+ Years



We are looking for a highly skilled Data Engineer with strong expertise in PySpark, Snowflake, and AWS Glue. The candidate will be responsible for designing, developing, and maintaining scalable data pipelines and solutions in a cloud environment, ensuring high performance and reliability.

Key Responsibilities:

Design and implement data ingestion, transformation, and integration pipelines using PySpark and AWS Glue.

Develop and optimize ETL workflows for large-scale data processing in AWS and Snowflake.

Collaborate with architects and stakeholders to define data architecture and technical roadmap for cloud migration and modernization.

Work on data modeling, performance tuning, and optimization for big data applications.

Ensure data quality, security, and compliance across all solutions.

Integrate data from multiple sources and manage data lake and data warehouse environments.

Implement CI/CD pipelines for data solutions using tools like Jenkins, GitHub Actions, or AWS CodePipeline.

Troubleshoot and resolve issues in production-grade projects handling terabyte to petabyte-scale datasets.



Required Skills & Qualifications:

5+ years of experience in data engineering and ETL development.

Strong hands-on experience with PySpark, Snowflake, and AWS Glue.

Proficiency in AWS services such as Lambda, EMR, Redshift, and S3.

Experience with data warehousing and modern data lake architectures.

Familiarity with big data technologies like Hadoop, Hive, Kafka.

Strong programming skills in Python (Scala or Java is a plus).

Expertise in SQL and query optimization.

Knowledge of DevOps practices and Agile methodologies.

Excellent analytical and problem-solving skills.



Preferred Skills:

Experience with Presto and cloud data warehouses.

Familiarity with data governance and security best practices.

Ability to work independently and in a team environment.



Education:

Bachelor s degree in Computer Science, Information Technology, or related field.



###

Skills

PySpark, Snowflake, AWS Glue, Lambda, Aws, Data warehousing, SQL



###

About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world's best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients' organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact--touching billions of lives in the process.