As a Big Data Engineer, you will be responsible for architecting, developing, and maintaining scalable data platforms. You will work on complex data migration projects, particularly transitioning from
MySQL to NoSQL
, while leveraging AWS cloud-based big data tools.
Key Responsibilities
Design, develop, and maintain large-scale data processing pipelines using
AWS Glue, Spark, and Scala
.
Implement scalable and efficient workflows with
AWS Step Functions and EMR
.
Lead and execute data migration projects from
MySQL to NoSQL databases
.
Collaborate with data scientists, analysts, and business teams to deliver clean and reliable data solutions.
Optimize big data processes for performance, scalability, and cost-efficiency.
Ensure data security, compliance, and governance best practices are followed.
Required Skills & Qualifications
5+ years of proven experience
as a Big Data Engineer.
Strong expertise in
AWS Glue, Spark, Scala, AWS Step Functions, and EMR
.
Solid hands-on experience with
data migration from MySQL to NoSQL
(e.g., DynamoDB, MongoDB, Cassandra).
Proficiency in designing and maintaining ETL pipelines and data integration solutions.
Strong problem-solving and debugging skills in large-scale data environments.
Familiarity with modern data architectures and best practices.
Good to Have (Optional)
Experience with Python or Java for big data applications.
Knowledge of CI/CD practices for data workflows.
Exposure to data warehousing and analytics tools.
Why Join Us?
Opportunity to work on
cutting-edge big data projects
.
Collaborative and innovative work culture.
Career growth and continuous learning environment.
Competitive salary and benefits package
Job Types: Full-time, Permanent
Pay: Up to ₹2,000,000.00 per year
Benefits:
Health insurance
Provident Fund
Work Location: In person
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.