Kafka Developer

Must Have Technical/Functional Skills

 

Primary Skill: Kafka Developer

Secondary: Hadoop

Experience: Minimum 10 years

 

Roles & Responsibilities

 

Responsible for designing, building, and optimizing real-time data streaming applications and event-driven architecture. They write producer and consumer code, build scalable data pipelines, and configure clusters using tools like Kafka Streams, Connect, and Schema Registry.

 

· Pipeline Development: Design and maintain reliable, high-throughput, and fault-tolerant data pipelines.

· Cluster Management: Set up, configure, and monitor Kafka brokers, topics, and partitions.

· Integration & Processing: Use Kafka Connect to integrate with external systems and utilize Kafka Streams or KSQL for real-time stream processing.

· Troubleshooting & Optimization: Analyze bottlenecks, optimize cluster performance, and resolve message delivery or serialization issues