to design, develop, and maintain scalable big data applications. The ideal candidate will have strong expertise in Core Java, Apache Spark, and data processing frameworks, with a solid background in working with relational databases and orchestration tools.
Primary Responsibilities:
Design, develop, and maintain Java-based big data applications using
Apache Spark
.
Work with
data frames
and
Spark-SQL
to process and analyze large datasets.
Integrate and manage
relational databases
such as MySQL, PostgreSQL, Oracle, or Db2.
Utilize
orchestration frameworks
to automate and manage data workflows.
Collaborate with
data engineers
to design and implement end-to-end data processing pipelines.
Write
clean, maintainable, and efficient code
following best practices.
Conduct
code reviews
and provide constructive feedback to team members.
Troubleshoot and resolve
performance issues
and
software defects
.
Stay updated with industry trends and emerging technologies in big data and Java development.
Skills Required:
Strong proficiency in
Core Java
.
5 to 7 years
of hands-on experience with
Apache Spark
, including
Spark-SQL
and
data frames
.
Experience working with
relational databases
(e.g., Db2, PostgreSQL, MySQL).
Knowledge of
orchestration frameworks
(e.g., Airflow, Oozie, or similar).
Solid understanding of
big data processing and analytics
.
Excellent
problem-solving skills
and
attention to detail
.
Strong
communication
and
collaboration
abilities.
Skills Desired (Nice to Have):
Familiarity with
distributed file systems
(e.g., HDFS, S3).
Experience with
CI/CD tools
such as Jenkins or GitLab CI.
Understanding of
data warehousing concepts
.
Exposure to
Agile/Scrum
methodologies.
Additional Information:
Reporting To:
[Insert Manager/Lead Name or Position]
Work Environment:
[On-site/Remote/Hybrid]
Compensation:
[Insert Salary/Rate, if applicable]
Skills
Core Java,Apache spark,Relational Database
About UST
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world's best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients' organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact--touching billions of lives in the process.
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.