Location: On-site - Bengaluru, India Duration: 12-Month Contract Client: Rate: As per market standards
Overview
We are seeking a highly experienced Kafka Architect to lead the design, administration, and maintenance of enterprise-grade Kafka and Confluent platforms. This is a hands-on role ideal for professionals who can architect scalable streaming solutions and ensure high availability across distributed systems.
Key Responsibilities
Architect and implement Kafka-based messaging solutions for high-throughput, low-latency applications
Design and manage Kafka Confluent clusters, including configuration, scaling, and performance tuning
Lead Kafka platform administration, including upgrades, patching, and monitoring
Collaborate with development and operations teams to integrate Kafka into enterprise systems
Define best practices for topic design, partitioning, replication, and retention policies
Ensure robust security and access control across Kafka environments
Troubleshoot production issues and optimize throughput and reliability
Document architecture, configurations, and operational procedures
? Required Skills & Experience
8+ years of experience in distributed systems or messaging platforms
5+ years of hands-on experience with Apache Kafka and Kafka Confluent
Strong expertise in Kafka architecture, topic design, and stream processing
Experience with Kafka Connect, Schema Registry, and KSQL
Proficiency in Kafka administration, including cluster setup, monitoring, and tuning
Familiarity with DevOps tools (Prometheus, Grafana, ELK, etc.) for Kafka observability
Solid understanding of data serialization formats like Avro and JSON
Strong scripting skills (Shell, Python) for automation and maintenance
Excellent problem-solving and communication skills
Preferred Qualifications
Experience with cloud-based Kafka deployments (AWS MSK, Confluent Cloud)
Knowledge of microservices architecture and event-driven design patterns
Exposure to CI/CD pipelines and containerization (Docker, Kubernetes)