Why this role stands out
You'll gain invaluable experience building and operating cutting-edge AI cloud infrastructure, directly impacting the reliability and scalability of Gimlet's innovative platform. This role is perfect for a technically driven individual eager to master diverse systems and contribute to the future of AI hardware. Apply today to shape the backbone of advanced AI!
Quick overview
Job description
About us
Gimlet is building the first multi-silicon neocloud designed for fast, efficient AI inference.
We combine large-scale compute infrastructure with an execution platform that partitions AI workloads and maps each stage to the hardware best suited to run it.
We work with foundation labs, hyperscalers, and AI-native companies, giving our team access to technical problems spanning frontier models, production infrastructure, and emerging hardware.
About the role
As an Infrastructure Platform Engineer, you will build the systems that turn heterogeneous accelerator hardware into reliable production infrastructure for Gimlet's AI cloud.
Gimlet's fleet spans hardware with different architectures, software stacks, operational characteristics, and failure modes. Your work will determine how new hardware is brought online, how clusters are provisioned and operated, and how production inference systems remain reliable as the fleet scales.
You will work across bare metal, Linux, Kubernetes, cluster scheduling, observability, and automation. You will build systems that abstract differences between accelerator architectures, make new hardware production-ready, and improve the reliability and operability of Gimlet’s infrastructure.
What success looks like
In your first 12–18 months, you will:
Deploy and operate production clusters across different accelerator architectures
Automate hardware provisioning, validation, upgrades, and fleet lifecycle management
Improve cluster scheduling, resource utilization, isolation, and capacity management
Build observable infrastructure that enables faster debugging, incident response, and recovery
Partner across distributed systems, runtime, compiler, networking, and hardware teams to bring new accelerators into production
You may be a good fit if you have
Experience in infrastructure, cluster engineering, platform engineering, SRE, or HPC
Strong Linux systems knowledge and production debugging experience
Experience operating Kubernetes, Slurm, Nomad, or similar orchestration systems
Experience automating infrastructure with Python, Go, Terraform, Ansible, or similar tools
Experience with GPU or accelerator infrastructure, including drivers, firmware, or CUDA/ROCm
The ability to build systems that are observable, recoverable, and reliable in production
A bachelor’s degree in a relevant field or equivalent practical experience
Strong candidates may also have
Experience building or operating AI inference, training, HPC, or neocloud infrastructure
Experience with bare-metal provisioning, PXE/iPXE, image pipelines, BIOS/firmware management, or rack bring-up
Experience with multi-tenant cluster isolation, quota systems, fair scheduling, or usage accounting
Experience debugging distributed workload performance across compute, memory, network, and storage bottlenecks
Experience building observability platforms using technologies such as Prometheus, OpenTelemetry, Grafana, or similar tooling
Familiarity with heterogeneous hardware environments across NVIDIA, AMD, Intel, ARM, or emerging accelerators
Why join now?
Gimlet is expanding from its core technology into a production neocloud spanning new hardware, customers, and data centers.
Solve hard problems.
Own meaningful work.
Build for production.
Help define what’s next.
Agency Policy: Gimlet Labs does not accept unsolicited resumes from recruitment agencies or search firms. Any unsolicited resumes submitted without a signed agreement will be considered the property of Gimlet Labs, and no fees will be paid.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- PI

Engineering InternRecently posted Auto Apply
Parabola Io · San Francisco · On-site · Posted 17 Nov 2026 🇺🇸
EngineeringSalary not listed - HE
Associate Engineer (New Grad)Recently posted Auto Apply
Helicon · Los Angeles (Torrance) · On-site · Posted 17 Nov 2026 🇺🇸
OnboardingRoboticsCAD+2EngineeringSalary not listed - HE
Responsible EngineerRecently posted Auto Apply
Helicon · Los Angeles (Torrance) · On-site · Posted 17 Nov 2026 🇺🇸
OnboardingRoboticsCAD+2EngineeringSalary not listed - HE
Founding Engineer, CAD & SimulationRecently posted Auto Apply
Helicon · Los Angeles (Torrance) · On-site · Posted 17 Nov 2026 🇺🇸
RoboticsCADCFD+3EngineeringSalary not listed - HE
Founding Software EngineerRecently posted Auto Apply
Helicon · Los Angeles (Torrance) · On-site · Posted 17 Nov 2026 🇺🇸
RoboticsPythonTypeScriptTechnologySalary not listed - CL

Software Engineer, Admin DashboardRecently posted Auto Apply
Clever · San Francisco · Hybrid · Posted 18 Nov 2026 🇺🇸
DynamoDBMicroservicesMongoDB+6Technology$115k - $135k/yr - CR

Systems Reliability Engineer Auto Apply
CFD Research Corporation · Huntsville · Hybrid · Posted 10 Nov 2026 🇺🇸
AssemblyCFDCompliance+1TechnologySalary not listed - AO
Senior Software Engineer, Vehicle Platform IntegrationsRecently posted Auto Apply
Aurora Operations Inc · Pittsburgh · Hybrid · Posted 17 Nov 2026 🇺🇸
RoboticsC++LinuxTechnology$146k - $234k/yr - TE

Senior Software Engineer, ReliabilityRecently posted Auto Apply
Temporal · United States (Remote) · Remote · Posted 17 Nov 2026 🇺🇸
Capacity PlanningLLMTriage+1TechnologySalary not listed - MG
Senior Java Engineer - Order Management SystemRecently posted Auto Apply
Man Group · Massachusetts · On-site · Posted 17 Nov 2026 🇺🇸
DockerMicroservicesMongoDB+31Technology$150k - $170k/yr - UP

Software Engineer II, Marketplace OptimizationRecently posted Auto Apply
Upstart · United States | Remote · Remote · Posted 17 Nov 2026 🇺🇸
RubyKotlinPython+4Technology$142k/yr - PG

Software Engineer II Platform Data ReliabilityRecently posted Auto Apply
PlayStation Global · United States · Hybrid · Posted 17 Nov 2026 🇺🇸
DynamoDBGCPAWS+7Technology$150.1k - $225.1k/yr
