Quick overview
Job description
We are seeking an experienced Technology Engineer with strong expertise in Redis, Kafka, and cloud-native platform engineering to join our Technology Engineering team. The ideal candidate will be responsible for designing, implementing, administering, and optimizing enterprise Redis and Kafka platforms supporting high-performance, real-time, mission-critical applications.
The role requires strong experience in distributed systems, platform engineering, automation, DevOps, cloud technologies, CI/CD, and production support. The successful candidate will work closely with development, infrastructure, security, and operations teams to ensure platform scalability, resilience, performance, and security.
Key Responsibilities
- Design, implement, configure, and manage Enterprise Redis and Open Source Redis clusters.
- Deploy, administer, and optimize Apache Kafka clusters for high-throughput, real-time streaming environments.
- Ensure high availability, scalability, resilience, disaster recovery, and security of Redis and Kafka platforms.
- Perform Redis and Kafka performance tuning, capacity planning, health monitoring, and optimization.
- Troubleshoot complex production issues across distributed platform environments.
- Manage platform upgrades, patching, configuration management, and lifecycle maintenance.
- Build and maintain CI/CD pipelines using Git, Jenkins, ArgoCD, and GitOps methodologies.
- Automate infrastructure provisioning and deployment using modern cloud automation tools.
- Support cloud-native platform deployments across AWS, Azure, OCI, and OpenShift environments.
- Collaborate with development teams to support caching, messaging, streaming, and distributed application requirements.
- Implement monitoring, alerting, logging, and operational best practices for production environments.
- Drive platform governance, engineering standards, security compliance, and operational excellence.
- Work closely with Infrastructure, DevOps, Security, Architecture, and Application Engineering teams.
- Support Agile delivery methodologies and participate in sprint planning, backlog refinement, and technical discussions.
- Research, evaluate, and benchmark new platform technologies and engineering best practices.
- Ensure platform compliance with organizational security, regulatory, encryption, anonymization, and data integrity standards.
Required Technical Skills
Redis
- Strong hands-on experience with Enterprise Redis and Open Source Redis.
- Redis Cluster design, deployment, administration, and management.
- Redis performance tuning and optimization.
- High Availability (HA), replication, clustering, backup, and disaster recovery.
- Redis security and production support.
Apache Kafka
- Kafka installation, setup, configuration, and administration.
- High-throughput messaging platforms.
- Kafka cluster management.
- Kafka monitoring and troubleshooting.
- Event-driven architecture implementation.
DevOps & Platform Engineering
- OpenShift.
- Jenkins.
- ArgoCD.
- Git.
- GitOps.
- CI/CD pipeline implementation.
- Infrastructure automation.
- Production platform support.
Cloud Technologies
Experience working with one or more public cloud platforms:
- AWS
- Microsoft Azure
- Oracle Cloud Infrastructure (OCI)
Distributed Systems
Strong understanding of:
- Distributed systems architecture
- Distributed services resiliency
- Network fundamentals
- Host-level routing
- Streaming platforms
- Distributed caching
- Performance tuning
- Large-scale platform operations
Streaming Technologies
Experience with:
- Kafka
- Streaming datasets at scale
Good to have:
- Kafka Streams
- Apache Flink
- Apache Beam
- Apache Spark
- Similar streaming technologies
Software Engineering
- Design patterns
- Automated unit testing
- Integration testing
- Production troubleshooting
- Platform monitoring
- Cloud-native application architecture
Security & Compliance
Strong understanding of:
- Security engineering practices
- Infrastructure security
- Encryption
- Data anonymization
- Data integrity
- Regulatory compliance
- Secure logging practices
- PII handling
- Memory data protection
- Vulnerability management
Functional Skills
- Experience working in Agile/Scrum environments.
- Strong analytical and problem-solving skills.
- Experience designing enterprise platform architectures.
- Technology research and benchmarking.
- Ability to influence engineering decisions across multiple teams.
- Strong ownership mindset with minimal supervision.
- Excellent troubleshooting and production support capabilities.
Soft Skills
- Excellent verbal and written communication skills.
- Strong stakeholder management and collaboration skills.
- Strategic thinking with an innovation and R&D mindset.
- Self-motivated and proactive approach to problem-solving.
- Ability to work effectively in cross-functional and geographically distributed teams.
- Strong presentation and interpersonal skills.
Nice to Have
- Apache Flink
- Apache Beam
- Kafka Streams
- Apache Spark
- Event-driven microservices
- Cloud-native architectures
- Infrastructure as Code (IaC)
- Kubernetes
- Container orchestration
- Large-scale financial services or enterprise platform experience
Preferred Experience
- Enterprise Platform Engineering
- Technology Platforms
- Data Platforms
- Real-Time Streaming Platforms
- Cloud Infrastructure
- High-Availability Distributed Systems
- Banking or Financial Services domain (preferred)
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- B2
Lead Engineer - R01574074Recently posted Auto Apply
Brillio 2 · Pune · Hybrid · Posted 20 Nov 2026 🇮🇳
ComplianceRegulatory ComplianceSalesforce+1EngineeringSalary not listed - B2
Lead Engineer - R01574073Recently posted Auto Apply
Brillio 2 · Pune · Hybrid · Posted 20 Nov 2026 🇮🇳
ComplianceRegulatory ComplianceSalesforce+1EngineeringSalary not listed - CA
FBS Agile Dev Team Member IV - Java with AngularRecently posted Auto Apply
Capgemini · Pune, Maharashtra · Hybrid · Posted 20 Nov 2026 🇮🇳
RxJSSQLSpring+12Salary not listed - CA
FBS Agile Dev Team Member IV - Java with AngularRecently posted Auto Apply
Capgemini · Hyderabad, Telangana · Hybrid · Posted 20 Nov 2026 🇮🇳
RxJSSQLSpring+12Salary not listed - RU
Software Engineer Product Infra: Core ServicesRecently posted Auto Apply
Rubrik · Bengaluru · Hybrid · Posted 20 Nov 2026 🇮🇳
DockerScalaAWS+8TechnologySalary not listed - RU
Software Engineer - Winter InternRecently posted Auto Apply
Rubrik · Bengaluru · Hybrid · Posted 20 Nov 2026 🇮🇳
ScalaC++Java+1TechnologySalary not listed - DA

Software Engineer, InfrastructureRecently posted Auto Apply
Databricks · Bengaluru · Hybrid · Posted 20 Nov 2026 🇮🇳
DockerGCPMicrosoft Excel+14TechnologySalary not listed - OP

Sr. Software Engineer (Full Stack)Recently posted Auto Apply
Opengov · Pune · On-site · Posted 20 Nov 2026 🇮🇳
AWSGrafanaGraphQL+5TechnologySalary not listed - OK

Senior Software Engineer - (Java & DSA)Recently posted Auto Apply
Okta · Bengaluru · Hybrid · Posted 19 Nov 2026 🇮🇳
MySQLSpringSpring Boot+12TechnologySalary not listed - IV

Associate Customer Application Engineer (.NET, SQL, C#)Recently posted Auto Apply
Ivalua · Pune · Hybrid · Posted 19 Nov 2026 🇮🇳
SQLC#.NET+2TechnologySalary not listed - FI

Staff Software EngineerRecently posted Auto Apply
Fivetran · Bengaluru · Hybrid · Posted 19 Nov 2026 🇮🇳
DockerGCPOracle+13TechnologySalary not listed - DA

Software Engineer II - IAM TeamRecently posted Auto Apply
DAT · Bengaluru · Hybrid · Posted 19 Nov 2026 🇮🇳
DockerGCPMicroservices+23TechnologySalary not listed