Quick overview
Job description
Key Responsibilities
- Architect & Scale Infra: Design and deploy secure, fault-tolerant cloud infrastructure across AWS/Azure/GCP, using Kubernetes, Terraform, and modern IaC tools.
- Enable Distributed AI Workloads: Build and optimize compute systems for distributed frameworks like Ray and Kafka, ensuring scalability and reliability.
- GPU Orchestration: Manage GPU resources and scheduling for ML inference, retrieval, and training workloads.
- Drive Observability & Reliability: Implement monitoring, security, and best practices for high-availability ML/AI systems.
- Collaborate Across Teams: Work hand-in-hand with ML researchers and data scientists to ensure infra accelerates, not hinders, development.
Who We’re Looking For
- We’re open to multiple levels of seniority (3–10+ years of engineering experience). What matters most is founder mindset + strong infra chops.
- Hands-on with Kubernetes + Terraform (real-world deployments, not just exposure).
- Experience with distributed systems (Ray, Dask, Spark, or similar).
- Exposure to Kafka or equivalent MQ systems.
- Strong programming/scripting in Python, Go, or similar.
- Track record of building or operating production-grade infra.
Nice to Haves
- GPU scheduling/optimization experience.
- Prior startup/early-stage build-from-scratch experience.
- Experience supporting ML/AI workloads in production.
- Founder Traits
- Excited to own infra end-to-end as the first dedicated hire.
- Comfort with ambiguity; thrives in fast-moving, collaborative teams.
- Curiosity + grit: hungry to learn where gaps exist.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- V1
Oracle Cloud Technical Consultant - Mid LevelRecently posted Auto Apply
Version 1 · Bengaluru, KA · Hybrid · Posted 17 Nov 2026 🇮🇳
Continuous ImprovementRoot Cause AnalysisTechnologySalary not listed - OR

SAP Cloud Platform LeadRecently posted Auto Apply
Orbia · Pune · Hybrid · Posted 17 Nov 2026 🇮🇳
Stakeholder ManagementOnboardingGit+8TechnologySalary not listed - GO

Director, Cloud InfrastructureRecently posted Auto Apply
Gohighlevel · India · Remote · Posted 17 Nov 2026 🇮🇳
Stakeholder ManagementGCPMicroservices+9TechnologySalary not listed - UE
Sr. Cloud Software EngineerRecently posted Auto Apply
Uei · Bengaluru · On-site · Posted 16 Nov 2026 🇮🇳
DockerSQLGit+20TechnologySalary not listed - UE
Cloud Software EngineerRecently posted Auto Apply
Uei · Bengaluru · On-site · Posted 16 Nov 2026 🇮🇳
DockerSQLGit+20TechnologySalary not listed - BI

Azure Cloud Architect - Generative AI PlatformRecently posted Auto Apply
BearingPoint India · Bengaluru · Hybrid · Posted 16 Nov 2026 🇮🇳
GCPAWSOAuth+17TechnologySalary not listed - MA

Member Technical staff-Compute Infra HPCRecently posted Auto Apply
Microsoft AI · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
RustBootstrapC#+8Salary not listed - WA
Senior Cloud SpecialistRecently posted Auto Apply
WSA APAC · Bengaluru · On-site · Posted 16 Nov 2026 🇮🇳
SQLGitApache Spark+3Salary not listed - NS
AWS Cloud EngineerRecently posted Auto Apply
Nemetschek SE2 · Bengaluru, Karnataka · Hybrid · Posted 16 Nov 2026 🇮🇳
DockerSQLGit+13TechnologySalary not listed - MI
Cloud Support Engineer IRecently posted Auto Apply
MicroStrategy · Pune, MAHĀRĀSHTRA · On-site · Posted 16 Nov 2026 🇮🇳
SQLHTMLAWS+7TechnologySalary not listed - WG
Assistant Manager- R&A | Azure dev ops Databricks | Cloud Platform Eng.Recently posted Auto Apply
WNS Global Services · Bengaluru, KA · Hybrid · Posted 16 Nov 2026 🇮🇳
SnowflakeDatabricksPowerShell+7AdministrativeSalary not listed - FI

Senior Platform / Infrastructure EngineerRecently posted Auto Apply
Firstwork · India · Remote · Posted 16 Nov 2026 🇮🇳
OnboardingDjangoGCP+19TechnologySalary not listed
