Job Description

Desired Competencies

• Kafka platform design, installation, operation, and the best practices for Brokers, Zookeepers, Kafka Connect/Connectors, Security Settings, JMX for Kafka monitoring and performance tuning.
• Setting up new Kafka clusters and onboarding Kafka API\'s
• Ensure availability for Kafka brokers, zookeepers, schema registry, and control center under defined SLA for different client environments.
• Topic management (creating, deleting, enable, disable, monitor).
• Connector management (installing connector plugin, creating, delete, enable, disable, monitor).
• Coordinate with application dev and Support teams to resolve access issues.
• Implement Kafka connectors to move data between systems.
• Upgrade, Installation, Patching and Deployment for Kafka.
• Implantation of Kafka Security Authentication and Authorization.
• High availability cluster setup, maintenance, creating topics, setup redundancy cluster.
• Experience in Real-time data streaming using Spark Streaming API, integration with Kafka.
• Creating a mirroring of Kafka Cluster brokers, broker sizing, topic sizing, hardware sizing, performance monitoring, broker security, topic security, consumer/producer access management (ACL).
• Integrating Kafka with other systems using connector like JDBC, file stream. Partition\'s reassignment to even distribute load between all brokers.
• Planning, onboarding kafka producers and consumers.
• Different type of user and group in Kafka Cluster.
• Understanding of Bootstrap server.
• Kafka Admin

NuStar Technologies