Job Description

Creating a better online experience with cookies. We care about your experience online, that's why we use cookies to make sure our website runs smoothly while personalising your visit for your ease of use and convenience. To choose what cookies you want to accept, select "Manage cookies". To accept all cookies for the best possible experience, select "Accept all". If you'd like to learn more about how we use cookies and to manage your selection, visit our Manage Cookies
Reject All Accept All
Search Jobs
Job Details
Specialist, Data Engineering

Requisition Number: 43285
Job Location: Bangalore, IND
Work Type: Office Working
Employment Type: Permanent
Posting Start Date: 04/12/2025
Posting End Date: 08/12/2025
:
Job Summary

• The Senior Engineer develops reusable frameworks and tools that enable teams to build pipelines and workflows efficiently. This role focuses on designing metadata-driven solutions for ETL, workflows, and data specifications, optimizing data integration processes, and ensuring seamless interaction with the platform's core components. The Framework Engineer also implements robust data quality and integrity checks, enabling a scalable and flexible framework for data engineering tasks across the organization.

Key Responsibilities
Strategy

• Framework Development: Design and implement flexible, metadata-driven frameworks for ETL, workflow orchestration, and data specifications to support efficient pipeline creation.
• Standardization: Establish best practices and reusable components for data ingestion, transformation, and processing to streamline efforts across teams.
• Metadata-Driven Design: Build frameworks leveraging metadata to define and automate ETL processes, workflows, and data specifications, ensuring flexibility and scalability.
• Data Quality Checks: Develop and integrate automated data quality checks into frameworks using tools like Great Expectations or similar solutions.
• Data Integrity Checks: Ensure frameworks include mechanisms to validate data integrity across pipelines, capturing schema changes, record counts, and column-level validations.
• Integration: Build seamless integrations with core platform components like Apache Iceberg, Spark, Kafka, Airflow, and Argo to enable consistent processing across batch and streaming workloads.
• Workflow Orchestration: Develop metadata-driven workflow orchestration frameworks to enable easy configuration and deployment of ETL processes.
• Reliability: Build frameworks with fail-safe mechanisms to handle errors and ensure reliability in pipeline execution.
• Compliance: Ensure frameworks adhere to governance policies and regulatory requirements

Business

• Enablement: Empower data engineers and analysts with user-friendly, metadata-driven frameworks to accelerate development and ensure consistency.
• Stakeholder Alignment: Collaborate with domain and platform teams to ensure frameworks address key business and technical requirements.

People & Talent

• Collaboration: Work closely with platform and data engineers to ensure frameworks align with infrastructure capabilities and operational requirements.
• Skill Sharing: Provide technical documentation and training to engineers and analysts using the frameworks.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
• Expertise in Scala, Java, Python, Spark with a focus on building reusable frameworks.
• Experience with metadata-driven framework design for ETL, workflow orchestration, and data specifications.
• Hands-on experience with Apache Spark, Kafka, and orchestration tools like Airflow.
• Good to have familiarity with governance tools like Apache Ranger, OpenLineage, and DataHub.

Skills and Experience

• Data Architecture
• Data Governance
• Big Data Management
• IT Governance
• Service Platform Operations
• Emerging Technologies
• Cloud Computing
• IT Standards, Procedures & Policies

About Standard Chartered
We're an international bank, nimble enough to act, big enough for impact. For more than 170 years, we've worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge and enjoy finding new opportunities to grow and do better than before. If you're looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents and we can't wait to see the talents you can bring us.
Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion.
Together we:

• Do the right thing and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do
• Never settle, continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well
• Are better together, we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term

What we offer
In line with our Fair Pay Charter, we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.

• Core bank funding for retirement savings, medical and life insurance, with flexible and voluntary benefits available in some locations.
• Time-off including annual leave, parental/maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum.
• Flexible working options based around home and office locations, with flexible working patterns.
• Proactive wellbeing support through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits
• A continuous learning culture to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning.
• Being part of an inclusive and values driven organisation, one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.

Information at a Glance
Standard Chartered 2025. All rights reserved.
x
Cookie preferences
Tell us which cookie categories you consent to by using the sliders below. You can change your preferences any time by clicking on Manage cookies on our homepage.
Stricly necessary cookies (always active)
Your security and privacy are our top priority, that's why these cookies are always on to ensure the safest and smoothest online experience.
Show More Details
Stricly necessary cookies (always active) Provider Description Enabled
SAP as service provider
We use the following session cookies, which are all required to enable the website to function:

• "route" is used for session stickiness
• "careerSiteCompanyId" is used to send the request to the correct data centre
• "JSESSIONID" is placed on the visitor's device during the session so the server can identify the visitor
• "Load balancer cookie" (actual cookie name may vary) prevents a visitor from bouncing from one instance to another

Functional Cookies
For your ease of use and convenience, these cookies remember the choices you made (e.g. language and region) and personalise our website to make it most relevant for you.
Show More Details
Functional Cookies Provider Description Enabled
YouTube
YouTube is a video-sharing service where users can create their own profile, upload videos, watch, like and comment on videos. Opting out of YouTube cookies will disable your ability to watch or interact with YouTube videos.
Advertising Cookies
To make sure we only send what's most relevant to your needs, these cookies help us and our partners understand what matters most to you. The data collected can be shared with third parties, such as advertisers or platforms, to create an ecosystem that is always relevant to you.
Show More Details
Advertising Cookies Provider Description Enabled
LinkedIn
LinkedIn is an employment-oriented social networking service. We use the Apply with LinkedIn feature to allow you to apply for jobs using your LinkedIn profile. Opting out of LinkedIn cookies will disable your ability to use Apply with LinkedIn.
Google Analytics
Google Analytics is a web analytics service offered by Google that tracks and reports website traffic.
Google Tag Manager
Google Tag Manager is a tag management system for conversion tracking, site analytics, remarketing and more.

Skills Required