Job Description

5 - 7 Years
1 Opening
Trivandrum

Role description

Senior Data Streaming Engineer Build, and maintain a real-time, file-based streaming data platform leveraging open-source technologies.



The ideal candidate will have experience with Kubernetes (K8s), Apache Kafka, and Java multithreading, and will be responsible for:



o Developing a highly performant, scalable streaming architecture optimized for high throughput and low memory overhead o Implementing auto-scaling solutions to support variable data loads efficiently



o Integrating reference data enrichment workflows using Snowflake o Ensuring system reliability and real-time processing across distributed environments



o Collaborating with cross-functional teams to deliver robust, cloud-native data solutions o Build scalable and optimized ETL/ELT workflows leveraging Azure Data Factory (ADF) and Apache Spark within Databricks.

Skills

Azure,KAFKA,JAVA,KUBERENETES

About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world's best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients' organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact--touching billions of lives in the process.