Job Description

This position is under ICG TTS Operations Technology (OpsTech) Group , to help the implementation of next generation Digital Automation Platform and Imaging Workflow Technologies. The Candidate is required to possess relevant experience in managing development teams in the distributed systems Eco-System and should be a strong team player.
It is expected that the candidate will have superior technical knowledge of current programming languages, technologies and other leading edge development tools.The overall objective of this role is to contribute to applications, systems analysis, and programming activities.
: Lead Spark Scala Engineer

• Hands on knowledge of SPARK, Py-Spark, scala, Java etc.
• Hands on knowledge of RDBMS like MS-SQL/Oracle
• Knowledge of CI/CD tools like LightSpeed, uDeploy etc

Responsibilities
Development & Optimization: Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal performance, scalability, and resource utilization.
Technical Leadership: Provide technical leadership and guidance to a team of data engineers, fostering a culture of technical excellence, collaboration, and continuous improvement.
Code Review & Best Practices: Conduct rigorous code reviews, establish coding standards, and enforce best practices for Spark Scala development, data governance, and data quality.
Performance Tuning: Identify and resolve performance bottlenecks in Spark applications through advanced tuning techniques (e.g., shuffling, partitioning, memory management, caching).
Deep Spark Expertise:
Profound understanding of Spark's architecture (RDDs, DataFrames, Datasets), execution model, and optimization techniques.
Extensive experience with Spark SQL, Spark Streaming, and Spark Core.
Proven ability to design and build complex data pipelines (ETL/ELT).
Scala Proficiency: Expert-level proficiency in Scala programming, including functional programming paradigms and object-oriented design.
Big Data Ecosystem: Strong hands-on experience with the broader Hadoop ecosystem (HDFS, YARN, Hive, Kafka, etc.) and related big data technologies.
Database Knowledge: Solid understanding of relational databases (SQL, schema design) and NoSQL databases.
Communication: Excellent communication, interpersonal, and leadership skills, with the ability to articulate complex technical concepts to diverse audiences.
Problem-Solving: Exceptional analytical and problem-solving abilities, with a meticulous attention to detail.
Education:
Bachelor's degree/University degree or equivalent experience
Job Family Group: Technology
Job Family: Applications Development
Time Type: Full time
Most Relevant Skills Please see the requirements listed above.
Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review .
View Citi's and the poster.