Job Description

Overview:
Should have a strong understanding of Kafka and the Elk (Elasticsearch, Logstash, Kibana) stack, including hands-on experience in implementing and maintaining these technologies Strong background in scripting and programming languages like Python, Java is essential for building and maintaining Kafka and Elk based solutions. In-depth knowledge and hands-on experience utilizing Log Shipper tools such as Fluentd, Fluent Bit, and Filebeat. Candidate should have excellent troubleshooting and problem-solving skills to identify and resolve issues in the Data Pipeline and ensure smooth operation. Investigate and resolve complex issues related to log data, log parsing, and ELK Stack performance Collaborate with cross-functional teams to integrate data from various sources into the data processing and analytics infrastructure. Stay updated with the latest trends and advancements in Kafka and ELK technologies and make recommendations for their implementation. Implement custom log parsing and data enrichment techniques to extract valuable insights from log data Take ownership of projects and ensure timely delivery of high-quality solutions. Create and maintain detailed documentation on ELK Stack configurations, architecture, and best practices. Assist in training and mentoring junior team members.

Responsibilities:

Responsible for designing, developing, automating, and maintaining software applications, participating in all phases of the software development lifecycle (SDLC).
Requirements:
Should have a strong understanding of Kafka and the Elk (Elasticsearch, Logstash, Kibana) stack, including hands-on experience in implementing and maintaining these technologies Strong background in scripting and programming languages like Python, Java is essential for building and maintaining Kafka and Elk based solutions. In-depth knowledge and hands-on experience utilizing Log Shipper tools such as Fluentd, Fluent Bit, and Filebeat. Candidate should have excellent troubleshooting and problem-solving skills to identify and resolve issues in the Data Pipeline and ensure smooth operation. Investigate and resolve complex issues related to log data, log parsing, and ELK Stack performance Collaborate with cross-functional teams to integrate data from various sources into the data processing and analytics infrastructure. Stay updated with the latest trends and advancements in Kafka and ELK technologies and make recommendations for their implementation. Implement custom log parsing and data enrichment techniques to extract valuable insights from log data Take ownership of projects and ensure timely delivery of high-quality solutions. Create and maintain detailed documentation on ELK Stack configurations, architecture, and best practices. * Assist in training and mentoring junior team members.