Kafka expert

InnovationTeam is a cutting-edge technology company that specializes in providing innovative solutions to businesses. We are currently seeking a skilled Kafka Expert to join our dynamic team.

As a Kafka Expert at InnovationTeam, you will play a critical role in designing, implementing, and managing Kafka infrastructure and solutions. You will be responsible for setting up Kafka clusters, configuring topics, managing partitions, and ensuring high availability and performance. Additionally, you will work closely with cross-functional teams to design and develop event-driven architectures leveraging Kafka for real-time data processing.

The ideal candidate for this role has a deep understanding of Kafka architecture and its components, along with hands-on experience in setting up and managing Kafka clusters in production environments. You should be well-versed in Kafka best practices and have a strong understanding of event-driven architectures and messaging patterns.

At InnovationTeam, we value innovation, teamwork, and continuous learning. We offer a collaborative and supportive work environment where your expertise is valued and opportunities for growth and development are provided.

If you are a passionate and experienced Kafka Expert looking for an exciting opportunity to work on cutting-edge technology, we would love to hear from you.

Key Responsibilities:

• Design and implement Kafka infrastructure including clusters, topics, and partitions
• Configure, monitor, and optimize Kafka for high performance and availability
• Ensure security and data privacy by implementing appropriate Kafka authentication and authorization mechanisms
• Collaborate with cross-functional teams to design and implement event-driven architectures using Kafka
• Integrate Kafka with other systems and technologies to enable seamless data exchange
• Troubleshoot and resolve issues related to Kafka infrastructure and applications
• Monitor performance, throughput, and latency of Kafka clusters
• Implement data streaming and processing pipelines using Kafka Streams or similar technologies

• BS/MS/B.Tech/BE/M.Tech in Computer Science or related field
• 5+ years of experience in big data or related field
• Strong knowledge of Kafka and other big data technologies like Hadoop, Spark, Hive
• In-depth knowledge of all the functionalities in Kafka ecosystem.
• Experience with Kafka Producer/Consumer APIs using Java/Python
• Experience with Kafka CLI, Kafka Connect, Kafka SQL, Schema Registry, Rest Proxy
• Ability to install, maintain and troubleshoot Kafka clusters
• Strong knowledge of message queuing systems ( i.e. JMS, RabitMQ …)
• Hands-on experience with multipe programming language like Java / Python / Scala etc.
• Good understanding of Distributed systems and Parallel processing
• Experience with Batch and Realtime processing applications 
• Working experience with relational / non-relational Databases
• Intermediate/Advanced SQL programming skills
• Hands-on experience with version control systems ( i.e. git , svn )
• Good understanding about CI/CD pipelines and tools ( i.e. jenkins )
• Hands-on experience with Linux shell scripting and debugging
• Good communication and interpersonal skills