. The ideal candidate will design, develop, and maintain data processing and orchestration pipelines leveraging modern cloud technologies such as
Apache Beam
,
Cloud Dataflow
, and
Airflow/Composer
.
Key Responsibilities:
Design, develop, test, and deploy
highly scalable and reliable data processing pipelines
using
Java 17+
and the
Apache Beam SDK
, executed on
GCP Cloud Dataflow
.
Build and manage
data orchestration workflows
using
Apache Airflow
or
GCP Cloud Composer
, including creation and maintenance of
DAGs
with common and custom operators.
Work with
GCP Big Data services
including
BigQuery
,
BigTable
, and
Google Cloud Storage (GCS)
to optimize data storage and processing.
Write, review, and optimize
complex SQL queries
for data retrieval, transformation, and analytics (especially in
BigQuery
and
Cloud SQL
).
Ensure
code quality, testing coverage
, and
technical documentation
are maintained to the highest standards.
Collaborate with senior engineers and stakeholders to deliver robust, secure, and efficient data solutions.
(Added Advantage)*:
+ Deploy and manage applications using
Google Kubernetes Engine (GKE)
.
+ Implement security best practices via
Identity and Access Management (IAM)
.
+ Work with
Cloud Spanner
and develop
secure REST APIs
for data access.
Mandatory Skills:
Proficiency in
Java 17+
Experience with
GCP Cloud Dataflow (Apache Beam SDK)
Hands-on with
Airflow/Composer
- creating and managing DAGs, operators
Strong understanding of
GCP Big Data services
-
BigQuery
,
BigTable
,
GCS
,
Cloud SQL
Excellent
SQL query writing and optimization
skills
Optional / Good-to-Have Skills:
Exposure to
GKE (Google Kubernetes Engine)
Knowledge of
IAM
for cloud security management
Experience with
Cloud Spanner
Basic understanding of
API development
Key Attributes:
Strong analytical and problem-solving mindset
Eagerness to learn emerging cloud technologies
Attention to detail and commitment to code quality
Good communication and collaboration skills
Skills
Gcp,java,cloud dataflow
About UST
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world's best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients' organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact--touching billions of lives in the process.
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.