Job Description

6 - 8 Years
1 Opening
Trivandrum

Role description

We are looking for an

Intermediate Data Engineer

with 6 years of proven experience in building scalable data pipelines and managing large-scale data processing systems. The ideal candidate should have strong hands-on expertise in

PySpark

,

SQL

, and

cloud platforms

(preferably

GCP

), along with experience working on big data technologies and orchestration tools.

Key Responsibilities

:

Design, implement, and optimize

data pipelines

for large-scale data processing. Develop and maintain ETL/ELT workflows using

Spark

,

Hadoop

,

Hive

, and

Airflow

. Collaborate with data scientists, analysts, and engineers to ensure data availability and quality. Write efficient and optimized

SQL

queries for data extraction, transformation, and analysis. Leverage

PySpark

and cloud tools (preferably

Google Cloud Platform

) to build reliable and scalable solutions. Monitor and troubleshoot data pipeline performance and reliability issues.

Required Skills

:

4-6 years of experience in a

Data Engineering

role. Strong hands-on experience with

PySpark

and

SQL

. Good working knowledge of

GCP

or any major cloud platform (AWS, Azure). Experience with

Hadoop

,

Hive

, and

distributed data systems

. Proficiency in data orchestration tools such as

Apache Airflow

. Ability to work independently in a fast-paced, agile environment.

Good to Have

:

Experience with data modeling and data warehousing concepts. Exposure to DevOps and CI/CD practices for data pipelines. Familiarity with other programming/scripting languages (Python, Shell scripting).

Educational Qualification

:

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field

Skills

PySpark,Hadoop,Hive,Gcp

About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world's best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients' organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact--touching billions of lives in the process.