Job Description

5 - 7 Years
2 Openings
Trivandrum

Role description

UST Job Title: Lead I - Data Engineering

Who we are:

At UST, we help the world's best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in over 25 countries, we build for boundless impact--touching billions of lives in the process. Visit us at .

The Opportunity

:



UST is looking for Lead Data Engineer

Key Roles & Responsibilities:

Design, develop, and maintain ETL/ELT data pipelines for batch and real-time data ingestion, transformation, and loading using Spark (PySpark/Scala) and streaming technologies (Kafka, Flink). Build and optimize scalable data architectures, including data lakes, data warehouses (BigQuery), and streaming platforms. Performance Tuning: Optimize Spark jobs, SQL queries, and data processing workflows for speed, efficiency, and cost-effectiveness Data Quality: Implement data quality checks, monitoring, and ing systems to ensure data accuracy and consistency.

Required Skills:

Understand requirements from the customer's perspective and ensure User story adherence for the feature being developed. Propose solution design and validate them with the technical architects in the team. Develop unit tests. Come up with innovative solutions in problem solving. Adhere to coding standards including performance and security of product. Adhere to development processes such as code review, JIRA updates, coding guidelines, release and delivery activities and efficient use of tools used for these processes. Ensure delivery of necessary artifacts such as design and feature documents, etc. Efficiently communicate with both internal and external stakeholders Demonstrate flexibility to move between maintenance and development tasks. Coordinate for change and release management activities.

Required Skills & Qualifications:

Programming: Strong proficiency in Python, SQL, and potentially Scala/Java. Big Data: Expertise in Apache Spark (Spark SQL, DataFrames, Streaming). Streaming: Experience with messaging queues like Apache Kafka, or Pub/Sub. Cloud: Familiarity with GCP, Azure data services. Databases: Knowledge of data warehousing (Snowflake, Redshift) and NoSQL databases. Tools: Experience with Airflow, Databricks, Docker, Kubernetes is a plus.

Experience Level

Total IT Experience - Minimum 8 years GCP - 4 + years of recent GCP experience

What we believe

:



We're proud to embrace the same values that have shaped UST since the beginning. Since day one, we've been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.

Humility:

We will listen, learn, be empathetic and help selflessly in our interactions with everyone.

Humanity:

Through business, we will better the lives of those less fortunate than ourselves.

Integrity:

We honour our commitments and act with responsibility in all our relationships.

Equal Employment Opportunity Statement

UST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.





All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.



UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.


To support and promote the values of UST.

Comply with all Company policies and procedures

Skills

kafka,spark,gcp development,etl process,

About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world's best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients' organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact--touching billions of lives in the process.