Why this role stands out
You can shape the future of AI infrastructure by joining Modal as a Member of Technical Staff, contributing to a rapidly growing, well-funded company defining a new computing era. This role offers significant opportunities for skill development and impact, perfect for engineers passionate about building foundational technology for cutting-edge AI workloads. Apply now to be part of this exciting journey.
Quick overview
Job description
About Us:
AI needs a new infrastructure layer. We're building it at Modal.
Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
Our customers include category-defining companies like Ramp, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.
We've passed $1B in annualized run rate, up 15x from a year ago. In October 2026 we raised a $750M Series D led by Accel at a $15.75B valuation.
Our team includes creators of popular open-source projects (e.g.,Seaborn,Luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.
The Role:
We are looking for strong engineers with experience and interest in designing, building, and maintaining the novel, high-performance systems that make up our serverless platform.
Specifically, you’ll be working on Modal’s machines layer: the fleet of bare-metal and cloud hosts that every Function, Sandbox, and training job runs on, and the control plane that provisions, images, monitors, and repairs them.
You’ll automate the integration of new capacity from a growing set of hardware providers, from auditing and benchmarking hosts and clusters to maintaining our machine images, configuring GPUs, RDMA, networking, and storage, and getting machines into production. You’ll build the automation that keeps the fleet healthy without human intervention: detecting bad GPUs, thermals, and disks. You’ll dig into whatever is between the hardware and the software that runs on top of it, whether that is a kernel panic, a broadcast storm during boot, or getting our container runtime to run on new architectures and platforms.
What You'll Work On:
Automate remediation of unhealthy machines (power cycling, reimaging, GPU recovery) to maximize uptime and minimize operator toil
Automate integration of new CPU, GPU, and storage servers into the fleet while managing hardware and network heterogeneity
Monitor network health and reliability across many datacenters, and standardize bare-metal network configuration
Automate hardware acceptance testing and benchmarking (CPU, disk, GPU, interconnect, network)
Build our custom network bootloader, machine image pipeline, and kernel and firmware management across the fleet
You May Be a Fit If:
You have 5+ years of experience writing high-quality production code
You’ve operated fleets of physical hardware (bare-metal provisioning, BMC/IPMI, PXE or network boot, firmware) or built the control planes that manage them (the more challenges you’ve worked through, the better)
You have strong cloud skills
You have strong knowledge of low-level operating system foundations (Linux kernel, drivers, networking, file systems, containers, etc.)
You’re effective at debugging across layers, from BGP flapping, Linux RPS, and vBIOS bugs to a Python control-plane service
You’re willing to step into the thick of it with our on-call rotation and respond to production incidents
Nice-to-Haves:
Experience with GPUs and the NVIDIA software stack in production (drivers, health monitoring, XIDs, RDMA/NVLink)
Prior experience with Go
Similar jobs
- VT

Senior Systems EngineerRecently posted Auto Apply
Voyager Technologies, Inc. · San Diego · Hybrid 🇺🇸
Embedded SystemsC++Python+2TechnologySalary not listed - ZS

Sr. Staff Software Development EngineerRecently posted Auto Apply
Zscaler · San Jose · Hybrid 🇺🇸
RecruitingDockerSpring+10TechnologySalary not listed - TE

Senior Software Engineer, PythonRecently posted Auto Apply
Telnyx · United States · Hybrid 🇺🇸
DockerFastAPINext.js+16TechnologySalary not listed - TE

Software Engineer, Elixir - TelephonyRecently posted Auto Apply
Telnyx · Brazil; Argentina; Texas · Hybrid 🇺🇸
DockerElixirGit+7TechnologySalary not listed - ZS

Staff Software Development EngineerRecently posted Auto Apply
Zscaler · San Jose · Hybrid 🇺🇸
RecruitingDockerSpring+10TechnologySalary not listed - SI

Software Engineer Intern- Engine-2027Recently posted Auto Apply
SingleStore · United States · Hybrid 🇺🇸
SQLC++TechnologySalary not listed - ST
AI Application EngineerRecently posted Auto Apply
Simple Technology Solutions · Washington · Hybrid 🇺🇸
DynamoDBGitAWS+11TechnologySalary not listed - SE

Distinguished Software Engineer, AIRecently posted Auto Apply
SecurityScorecard · Remote (US/CAN/LATAM) · Remote 🇺🇸
DockerAWSCAD+12TechnologySalary not listed - ST

Staff Software Engineer, Payments IntelligenceRecently posted Auto Apply
Stripe · New York · Hybrid 🇺🇸
RubyAirflowJava+3TechnologySalary not listed - SA

Forward Deployed Engineer II (Remote, US)Recently posted Auto Apply
Sayari · Remote - US · Remote 🇺🇸
DockerGCPSQL+14EngineeringSalary not listed - RM

Sr. Forward Deployed EngineerRecently posted Auto Apply
Re:Build Manufacturing · United States -Remote · Remote 🇺🇸
Microsoft OfficeAWSRobotics+14EngineeringSalary not listed - SM

Sr. Integration EngineerRecently posted Auto Apply
Scout Motors · Charlotte · Hybrid 🇺🇸
SQLGitAWS+10TechnologySalary not listed
