Quick overview
Job description
Job Summary
We are looking for a highly skilled RTS Kafka Engineer to design, build, and maintain scalable real-time streaming platforms. The ideal candidate will have strong hands-on experience with Apache Kafka, cloud-native architectures, and event-driven systems operating in high-throughput environments. This role involves building reliable streaming pipelines, enabling real-time data processing, and supporting cloud-based distributed systems.
Key Responsibilities
- Design, implement, and manage Kafka-based real-time streaming solutions in high-throughput environments.
- Perform Kafka setup, configuration, tuning, and performance optimization.
- Develop and maintain scalable event-driven and streaming architectures.
- Build and manage streaming data pipelines processing large-scale datasets.
- Implement CI/CD pipelines using tools such as Git, Jenkins, ArgoCD, or similar platforms.
- Work with cloud-native applications deployed across AWS, Azure, or OCI environments.
- Automate infrastructure and deployment using cloud automation toolsets.
- Apply GitOps practices for deployment and environment management.
- Ensure system reliability, scalability, and high availability.
- Implement automated unit testing and integration testing for streaming applications.
- Collaborate with DevOps, platform engineering, and application teams to deliver end-to-end real-time solutions.
- Apply software design patterns and best practices in distributed systems development.
Required Skills & Qualifications
- Strong hands-on experience with Apache Kafka setup, configuration, and administration.
- Experience working with high-volume streaming data platforms.
- Solid understanding of event-driven architecture and distributed systems.
- Experience with source control systems (Git).
- Hands-on exposure to CI/CD pipelines (Jenkins, ArgoCD, or similar).
- Experience with at least one public cloud platform:
- AWS
- Microsoft Azure
- Oracle Cloud Infrastructure (OCI)
- Knowledge of cloud automation tools and infrastructure automation.
- Understanding of GitOps methodology.
- Strong knowledge of software design patterns and implementation practices.
- Experience implementing automated testing (unit & integration testing).
Preferred Qualifications
- Experience with Kafka ecosystem tools (Kafka Connect, Schema Registry, ksqlDB).
- Exposure to containerization and orchestration platforms (Docker, Kubernetes, OpenShift).
- Experience with monitoring and observability tools (Prometheus, Grafana, ELK, etc.).
- Background in real-time systems (RTS) or financial transaction platforms is a plus.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- SI
Senior Data and Applied ScientistRecently posted Auto Apply
SAP IT Business Systeme · Gurugram, HARYANA · Hybrid · Posted 19 Nov 2026 🇮🇳
Generative AIPrompt EngineeringEngineeringSalary not listed - SI
AI Development ExpertRecently posted Auto Apply
SAP IT Business Systeme · Bengaluru, KA · Hybrid · Posted 19 Nov 2026 🇮🇳
Generative AIAgilePrompt EngineeringEngineeringSalary not listed - TE
SCADA EngineerRecently posted Auto Apply
Terabase Energy · India · Remote · Posted 18 Nov 2026 🇮🇳
Continuous ImprovementPLC ProgrammingSCADA+3EngineeringSalary not listed - CA
Senior FAST Engineer (Contract)Recently posted Auto Apply
Careers at KKR · Gurugram · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLScrumCompliance+6EngineeringSalary not listed - OP

Associate Implementation Engineer Auto Apply
Opengov · Pune · On-site · Posted 29 Oct 2026 🇮🇳
SQLMicrosoft ExcelETL+7EngineeringSalary not listed - FL

Senior ABAP EngineerRecently posted Auto Apply
Floqast · Pune · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLCPAPython+5EngineeringSalary not listed - ET

CSV Validation EngineerRecently posted Auto Apply
E Tech Group · Pune · Hybrid · Posted 18 Nov 2026 🇮🇳
ERPComplianceSCADA+2EngineeringSalary not listed - CL

Quality Engineer Auto Apply
Clinisys · Bengaluru · Hybrid · Posted 6 Nov 2026 🇮🇳
RecruitingSQLSelenium+9EngineeringSalary not listed - ON

Solution EngineerRecently posted Auto Apply
Onit · Pune · On-site · Posted 18 Nov 2026 🇮🇳
RubyMicrosoft OfficeArticulate+5EngineeringSalary not listed - SI
Senior Consultant - Python, MLops, Agentic AIRecently posted Auto Apply
SAP IT Business Systeme · Bengaluru · Hybrid · Posted 18 Nov 2026 🇮🇳
EngineeringSalary not listed - AC
Knowledge EngineerRecently posted Auto Apply
AccorCorpo · Gurugram, HR · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLGoogle CloudLLM+2EngineeringSalary not listed - DR
Team Member - Engineering (Utility)Recently posted Auto Apply
Dr Reddy's Laboratories Limited · Baddi, HP · On-site · Posted 18 Nov 2026 🇮🇳
5SComplianceContinuous Improvement+6EngineeringSalary not listed