, and modern big data technologies to design and build scalable, efficient data flows and pipelines in a
cloud environment
. The ideal candidate will have hands-on experience with real-time data ingestion using
Kafka
, proficiency in
Spark
for data processing, and familiarity with
AWS cloud services
such as
Glue
and
Athena
. This role demands strong programming skills, experience with
ETL frameworks
, version control proficiency, and a proactive, collaborative mindset for seamless delivery in
Agile teams
.
Key Responsibilities
Develop, design, and optimize data processing pipelines leveraging
Python
,
SQL
, and
Spark
.
Architect scalable and repeatable data flows and management solutions in a
Cloud environment
.
Utilize
Kafka
platform for real-time, high-volume data ingestion and processing.
Implement
infrastructure-as-code
practices for deployment consistency and reliability.
Maintain and use version control systems such as
GIT
; develop and update
technical documentation
.
Collaborate effectively with cross-functional teams, ensuring strong
communication
and agile delivery.
Apply
Agile
,
Scrum
, or
Kanban methodologies
to manage product delivery efficiently.
Qualifications
Bachelor's or Master's degree
in Computer Science, Information Systems, or related field.
Minimum
4 years
of professional experience building data pipelines and managing big data technologies.
Strong hands-on experience with
ETL frameworks
(e.g., Airflow, Jenkins) for production deployment.
Deep understanding of
data structures
and willingness to adopt new technologies.
Experience with
AWS cloud tools
, including
Glue
and
Athena
.
Proficient in
English
, with excellent communication skills.
Demonstrated ability to deliver data engineering solutions with a
product-oriented mindset
.
Job Type: Full-time
Pay: ₹2,500,000.00 - ₹5,000,000.00 per year
Application Question(s):
Can you join within 30 days if selected ?(Mandatory) What is your Current CTC ?(Mandatory)
Experience:
Kafka: 2 years (Required)
Spark: 2 years (Required)
Python: 2 years (Required)
ETL: 2 years (Required)
AWS: 2 years (Required)
Work Location: In person
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.