Job Description

:

Engineering Manager & Technical Architect - Full Stack Data Integration

Position Overview

We are seeking a seasoned Engineering Manager and Technical Architect with 13-17 years of industry experience to lead our data integration and full-stack development initiatives. This role combines hands-on technical leadership with team management, requiring deep expertise in building scalable applications that seamlessly integrate with diverse data ecosystems.


This role offers the opportunity to work at the intersection of

cutting-edge technology

and

team leadership, driving innovation

in

data-centric

applications while building and mentoring high-performing engineering teams.

Key Responsibilities

Technical Leadership & Architecture

Hands-on Full Stack Development

: Design and implement end-to-end solutions using modern full-stack technologies while maintaining architectural oversight

Data Integration Architecture

: Architect robust solutions for integrating applications with multiple data sources including: + Traditional databases (SQL/NoSQL)
+ Real-time streaming platforms (Kafka, Kinesis, Pulsar)
+ Structured data sources (APIs, data warehouses, lakes)
+ Unstructured data sources (document stores, blob storage, content management systems)

Cross-Application Communication

: Design and implement secure, scalable communication patterns between distributed systems using REST APIs, GraphQL, message queues, and event-driven architectures

Data Engineering Excellence

Data Pipeline Design

: Architect and implement robust ETL/ELT pipelines ensuring data integrity, quality, and lineage tracking

Apache Spark Mastery

: Design and optimize large-scale data processing workflows using Apache Spark for: + Batch processing and analytics
+ Streaming data processing (Spark Streaming/Structured Streaming)
+ Machine learning pipelines (Spark MLlib)
+ Complex data transformations at scale

Performance Optimization

: Design systems with optimal performance characteristics while maintaining data consistency and reliability

Data Governance

: Implement data quality frameworks, monitoring, and alerting systems to ensure data integrity across the ecosystem

Infrastructure & DevOps

Multi-Environment Deployment

: Design and manage deployment strategies across: + Kubernetes clusters (on-premises and cloud)
+ Public cloud platforms (AWS, Azure, GCP)
+ Hybrid and multi-cloud environments

Performance Engineering

: Implement comprehensive monitoring, profiling, and optimization strategies to achieve optimal performance-to-cost ratios

Cost Optimization

: Continuously analyze and optimize infrastructure costs while maintaining performance SLAs

Team Management & Leadership

Cross-Functional Team Leadership

: Manage diverse teams including: + Data Engineers
+ Application/Software Engineers
+ QA Engineers
+ DevOps Engineers

Project Management

: Drive project execution through effective task assignment, progress tracking, and risk mitigation

Strategic Planning

: Develop alternative solutions (Plan B/C) for critical project deliverables and technical challenges

Mentorship

: Provide technical guidance and career development for team members

Required Qualifications

Experience & Background

13-17 years

of progressive experience in software engineering and technical leadership roles

5+ years

in engineering management positions with direct team leadership experience

Proven track record

in similar Engineering Manager + Architect roles in data-intensive environments

Technical Expertise

Full Stack Proficiency

: Expert-level skills in modern full-stack technologies (React/Angular/Vue, Node.js/Python/Java, microservices)

Data Integration Mastery

: Deep understanding of data integration patterns, API design, and inter-system communication protocols

Database Technologies

: Extensive experience with both SQL (PostgreSQL, MySQL, Oracle) and NoSQL (MongoDB, Cassandra, Redis) databases

Apache Spark Expertise

: Hands-on experience with: + Spark Core, SQL, Streaming, and MLlib
+ Performance tuning and optimization of Spark applications
+ Integration with distributed storage systems (HDFS, S3, Delta Lake)
+ Spark deployment on Kubernetes and cloud environments

Streaming Technologies

: Hands-on experience with real-time data processing using Kafka, Apache Storm, Spark Streaming, or similar

Cloud & Infrastructure

: Production experience with: + Kubernetes orchestration and management
+ Major cloud platforms (AWS/Azure/GCP)
+ Infrastructure-as-Code (Terraform, CloudFormation)
+ CI/CD pipelines and DevOps practices

Preferred Qualifications

Open Source Contribution

: Active participation in open-source projects and communities, especially Apache Spark ecosystem

Industry Certifications

: Cloud certifications (AWS/Azure/GCP Solutions Architect), Kubernetes certifications, or Databricks certifications

Advanced Apache Spark

: Experience with Spark optimization techniques, custom data sources, and extending Spark functionality

Domain Expertise

: Experience in specific industries (fintech, healthcare, e-commerce) with complex data requirements

What You'll Deliver

Scalable, maintainable full-stack applications with seamless data integration capabilities High-performing Apache Spark applications processing large-scale data with optimal resource utilization High-performing, cost-optimized infrastructure deployments across multiple environments Well-functioning, motivated engineering teams delivering consistent results Robust data pipelines ensuring data integrity and optimal performance Strategic technical roadmaps with comprehensive risk mitigation plans

Years Of Exp

:
10 to 18 years

Mandatory Skills

:
Python, Spark, Data Integration, Fullstack,

Location

:
Bengaluru, Karnataka, India

Why you should choose us?

=============================


Are you interested in working for a Global Leader in E-commerce? Are you excited about working on highly scalable platforms and applications that are accessed by millions of users every day? If so, read on to find out more about the opportunity.


Rakuten is the largest E-commerce company in Japan and one of the largest E-commerce and Internet Services companies in the World. Rakuten is ranked in top 20 most innovative companies in the world by Forbes.


Rakuten India Development Centre is the second largest technology hub outside of Japan that enables & builds platforms for global E commerce, Payments, Digital, AI, Data Science services across the globe. The India arm serves as a research and development center with an employee strength of around 450+ (& Growing).


Rakuten is committed to cultivating and preserving a culture of inclusion and connectedness. We are able to grow and learn better together with a diverse team and inclusive workforce. The collective sum of the individual differences, life experiences, knowledge, innovation, self-expression, and talent that our employees invest in their work represents not only part of our culture, but our reputation and Rakuten's achievement as well. In recruiting for our team, we welcome the unique contributions that you can bring in terms of their education, opinions, culture, ethnicity, race, sex, gender identity and expression, nation of origin, age, languages spoken, veteran's status, color, religion, disability, sexual orientation and beliefs"