Quick overview
Job description
Key Responsibilities
- Architect & Scale Infra: Design and deploy secure, fault-tolerant cloud infrastructure across AWS/Azure/GCP, using Kubernetes, Terraform, and modern IaC tools.
- Enable Distributed AI Workloads: Build and optimize compute systems for distributed frameworks like Ray and Kafka, ensuring scalability and reliability.
- GPU Orchestration: Manage GPU resources and scheduling for ML inference, retrieval, and training workloads.
- Drive Observability & Reliability: Implement monitoring, security, and best practices for high-availability ML/AI systems.
- Collaborate Across Teams: Work hand-in-hand with ML researchers and data scientists to ensure infra accelerates, not hinders, development.
Who We’re Looking For
- We’re open to multiple levels of seniority (3–10+ years of engineering experience). What matters most is founder mindset + strong infra chops.
- Hands-on with Kubernetes + Terraform (real-world deployments, not just exposure).
- Experience with distributed systems (Ray, Dask, Spark, or similar).
- Exposure to Kafka or equivalent MQ systems.
- Strong programming/scripting in Python, Go, or similar.
- Track record of building or operating production-grade infra.
Nice to Haves
- GPU scheduling/optimization experience.
- Prior startup/early-stage build-from-scratch experience.
- Experience supporting ML/AI workloads in production.
- Founder Traits
- Excited to own infra end-to-end as the first dedicated hire.
- Comfort with ambiguity; thrives in fast-moving, collaborative teams.
- Curiosity + grit: hungry to learn where gaps exist.
Why Join
- A rare chance to be a founding engineer shaping both company and product direction.
- Competitive salary, benefits, and meaningful equity.
- Work alongside engineers and researchers from LinkedIn, Visa, Meta, and Branch.
- Onsite culture in San Mateo, designed for deep collaboration and high-velocity building.
- We offer competitive compensation, equity, full benefits (Medical, Dental, Vision, 401k)
- We sponsor H-1B visas and assist with immigration processes
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- SI

Sr. Engineer, Infrastructure Engineering | 1820Recently posted Auto Apply
SiTime Corporation · California · Hybrid · Posted 17 Nov 2026 🇺🇸
AssemblyAltiumPCB Design+2$124.9k - $171.8k/yr - SE

Azure Web ServicesRecently posted Auto Apply
Systems Engineering Solutions Corporation · Huntsville, Alabama · On-site · Posted 16 Nov 2026 🇺🇸
DockerGCPOracle+26Salary not listed - SE

Azure Web ServicesRecently posted Auto Apply
Systems Engineering Solutions Corporation · Boston, Massachusetts · On-site · Posted 16 Nov 2026 🇺🇸
DockerGCPOracle+26Salary not listed - IC

Cloud Security Engineer - Assistant Vice PresidentRecently posted Auto Apply
iCapital · New York · Hybrid · Posted 16 Nov 2026 🇺🇸
GCPAWSCDK+8Technology$130k - $160k/yr - AF
Cloud and Database EngineerRecently posted Auto Apply
Accenture Federal Services · Arlington · Hybrid · Posted 16 Nov 2026 🇺🇸
DockerSQLAWS+13Technology$120.4k - $234.7k/yr - CL

Founding Engineer, InfrastructureRecently posted Auto Apply
Clera · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
DockerAWSConcrete+3$175k - $300k/yr - VA

Senior Cloud Infrastructure EngineerRecently posted Auto Apply
Valon · Remote · Remote · Posted 16 Nov 2026 🇺🇸
OnboardingDockerGCP+9TechnologySalary not listed - TT
Senior Infrastructure EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
GCPAWSCompliance+6Technology$150k - $300k/yr - WE

Senior Infrastructure Engineer Auto Apply
Webflow · United States · Remote · Posted 2 Nov 2026 🇺🇸
MongoDBApache SparkAWS+14Technology$165k - $225k/yr - NI

Staff Cloud Security Engineer Auto Apply
Ninjatrader · Chicago · Hybrid · Posted 30 Oct 2026 🇺🇸
GCPAWSEncryption+13TechnologySalary not listed - LT
Senior Cloud Engineer Auto Apply
Liveview Technologies · Seattle · Hybrid 🇺🇸
GitAWSArgoCD+9TechnologySalary not listed - LA

Cloud Security EngineerRecently posted Auto Apply
Latacora · United States · Remote · Posted 13 Nov 2026 🇺🇸
GCPGoogle WorkspaceGit+7Technology$125k - $160k/yr
