Job Description

Data Engineer / Sr. Data Engineer- (6-12 Years)

Location: Gurgaon, Bangalore

Your future employer:

Founded in 2001, it is based in San Francisco and employs 450 professionals across offices in San Francisco, Los Angeles, New York, Chicago, London, Singapore, Dubai and Gurgaon

It combines Decision Engineering with advanced analytics to transform how companies across the globe make decisions. Over a decade of global services expertise includes big data, advanced analytics, predictive modelling, marketing analytics, CRM, IoT solutions and data management services.

Together, these products and services empower Fortune 1000 companies to make better marketing investments, create more lucrative customers, achieve operational excellence and compete at a higher level

As a Data Engineer, you will be a key player in architecting, building, and maintaining our data infrastructure to support real-time stream data processing and analytics. Drawing upon your 7-10 years of hands-on experience with Apache Kafka, real-time stream data processing, AWS, Presto, and Trino, you will work with a team of data engineers to develop scalable, robust, and high-performance data solutions that drive critical insights and decisions across the organization.

Responsibilities: * Lead/Incubate the design, development, and implementation of data pipelines leveraging Apache Kafka, AWS services, Presto, and Trino to enable real-time data processing.

• Collaborate closely with data analysts, and business stakeholders to understand data requirements and translate them into efficient and scalable data solutions.
• Deliver high-quality, well-structured code, and provide technical leadership and best practices for data engineering projects.
• Implement data quality checks and validation processes at various stages of the data pipeline to guarantee data integrity.
• Optimize data pipelines and data workflows for performance and cost-effectiveness, and proactively identify and resolve any data-related issues.
• Collaborate with the infrastructure team to leverage AWS cloud services for scalable and reliable data storage, processing, and computing needs.
• Explore and evaluate new data technologies and tools to continuously improve our data engineering capabilities and stay ahead in the industry.
• Work closely with cross-functional teams to understand business objectives and align data engineering initiatives with the overall company strategy.

Qualifications: * 6-12 years of hands-on experience in data engineering with expertise in Apache Kafka, real-time stream data processing, AWS Services, Presto, and Trino.

• Strong proficiency in programming languages such as Java, Python, or Scala, and expertise in SQL and NoSQL databases.
• In-depth knowledge of data modelling, ETL processes, and data warehousing principles.
• Experience with AWS cloud services for data storage, processing, and data management.
• Familiarity with containerization technologies such as Docker and Kubernetes is a plus.
• Excellent problem-solving skills and the ability to architect and implement complex solutions.
• Strong communication and interpersonal skills, with the ability to collaborate effectively with stakeholders at various levels.

What is in it for you? * An opportunity to be a part of the Global Technology team as well as the Global Service Delivery team in India.

• Opportunity to thrive in a culture that is committed to accelerate equality for all. Engage in boundaryless collaboration across the entire organization.

Reach Us:

If you think this is the right opportunity for you, feel free to apply or forward your application with your updated resume at Manisha.jha@crescendogroup.in for further discussions.

Disclaimer:

Crescendo Global is an ISO 9001:2015 certified Leadership Hiring consulting arm of Crescendo Group with expertise in mid to senior level niche recruitment.

We are passionate about empowering job seekers and employers with an engaging memorable job search and leadership hiring experience. Crescendo Global does not discriminate on the basis of race, religion, color, origin, gender, sexual orientation, age, marital status, veteran status or disability status.

Keywords: Crescendo Global, Crescendo, Jobs in India, Jobs in Gurgaon, Jobs in Data Engineering, Jobs in Bangalore, Jobs in Kafka, Jobs in Apache, Jobs in AWS, Jobs in Athena, Jobs in Presto,Hybrid Jobs

Crescendo Global