Lead Data Engineer

Year    KA, IN, India

Job Description

About us:



Working at Target means helping all families discover the joy of everyday life. We bring that vision to life through our values and culture. Learn more about Target here.

About the Role:



As a

Lead Data Engineer

, you will serve as the

technical anchor

for the engineering team, responsible for designing and developing

scalable, high-performance data solutions

. You will

own and drive data architecture

that supports both functional and non-functional business needs, ensuring

reliability, efficiency, and scalability

.

Your expertise in

big data technologies, distributed systems, and cloud platforms

will help shape the engineering roadmap and best practices for

data processing, analytics, and real-time data serving

. You will play a key role in

architecting and optimizing data pipelines

using

Hadoop, Spark, Scala/Java, and cloud technologies

to support enterprise-wide data initiatives.

Additionally,

experience with API development for serving low-latency data

and

Customer Data Platforms (CDP)

will be a strong plus.

Key Responsibilities:



Architect and build

scalable, high-performance data pipelines

and

distributed data processing solutions

using

Hadoop, Spark, Scala/Java, and cloud platforms (AWS/GCP/Azure)

. Design and implement

real-time and batch data processing solutions

, ensuring data is efficiently processed and made available for analytical and operational use.

Develop APIs and data services

to expose

low-latency, high-throughput

data for downstream applications, enabling real-time decision-making. Optimize and enhance

data models, workflows, and processing frameworks

to improve performance, scalability, and cost-efficiency. Drive

data governance, security, and compliance

best practices. Collaborate with

data scientists, product teams, and business stakeholders

to understand requirements and deliver

data-driven solutions

. Lead the

design, implementation, and lifecycle management

of data services and solutions. Stay up to date with

emerging technologies

and drive adoption of best practices in

big data engineering, cloud computing, and API development

. Provide

technical leadership and mentorship

to engineering teams, promoting best practices in

data engineering and API design

.

About You:



7+ years of experience in data engineering, software development, or distributed systems.

Expertise in big data technologies

such as

Hadoop, Spark, and distributed processing frameworks.

Strong programming skills in Scala and/or Java

(Python is a plus).

Experience with cloud platforms (AWS, GCP, or Azure)

and their

data ecosystem

(e.g., S3, BigQuery, Databricks, EMR, Snowflake, etc.).

Proficiency in API development

using

REST, GraphQL, or gRPC

to serve real-time and batch data.

Experience with real-time and streaming data architectures

(Kafka, Flink, Kinesis, etc.). Strong knowledge of

data modeling, ETL pipeline design, and performance optimization

. Understanding of

data governance, security, and compliance

in large-scale data environments.

Experience with Customer Data Platforms (CDP) or customer-centric data processing

is a strong plus. Strong problem-solving skills and ability to work in

complex, unstructured environments

. Excellent communication and collaboration skills, with experience working in

cross-functional teams

.

Why Join Us?



Work with cutting-edge

big data, API, and cloud technologies

in a fast-paced, collaborative environment. Influence and shape the

future of data architecture and real-time data services

at Target. Solve

high-impact business problems

using

scalable, low-latency data solutions

. * Be part of a culture that values

innovation, learning, and growth

.

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD3902536
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    KA, IN, India
  • Education
    Not mentioned
  • Experience
    Year