Job Description

Key responsibilities:

Design, develop, and maintain kafka-based data streaming solutions using

kafka connect

and

kafka streams

. Integrate various data sources and sinks with apache kafka. Implement real-time data processing pipelines. Develop and maintain custom kafka connectors when required. Monitor, troubleshoot, and optimize kafka clusters for performance and reliability. Collaborate with software engineers, devops, and data teams to ensure seamless data flows. Document system architecture, configurations, and processes.

Required skills & qualifications:

4+ years of hands-on experience with

apache kafka

. In-depth knowledge and practical experience with

kafka connect

and

kafka streams

. Strong proficiency in

java

or

scala

. Good understanding of messaging systems, stream processing, and distributed systems. Experience with schema registry, avro, or protobuf serialization formats. Hands-on experience with kafka tools like mirrormaker, ksqldb, kafka control center, etc. Familiarity with containerization tools like

docker

and orchestration using

kubernetes

is a plus. Working knowledge of monitoring tools like

prometheus

,

grafana

, or

elk stack

. Experience with cloud platforms (aws/gcp/azure) is an added advantage.
Job Types: Full-time, Freelance

Pay: Up to ?150,000.00 per month

Work Location: In person