Quick overview
Job description
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
Storage decides how fast agent sandboxes start and how safely they share data. Agents need a filesystem that thousands of sandboxes mount at the same time, with strict isolation and the consistency agents need. Agent context is mostly small files, so the access patterns look very different from storage built for large files.
The Agent Infra team builds Agent Drive, the distributed filesystem that agent sandboxes mount over FUSE, and the storage underneath it. The work uses tiered caching, replication, content-addressed data, and Linux filesystem internals. In September 2026, Baseten acquired Blaxel, whose sandboxes and Agent Drive filesystem are the foundation for Baseten Sandboxes.
We are building a cloud, not just using one, so storage is designed for many tenants from day one. The team is small and ownership is big: we ship in weeks and months, not multi-year programs.
If you care about page cache coherency, FUSE, replication protocols, and content-addressable storage, we'd love to talk.
EXAMPLE INITIATIVES
RESPONSIBILITIES
Design and implement core Agent Drive features: metadata replication, volume placement, garbage collection, and FUSE client behavior
Solve multi-attach correctness: cache coherency across many FUSE mounts of the same drive, dentry and inode invalidation, write ordering, and crash consistency
Optimize tail latency on read and write paths, including page cache strategy, writeback, prefetch, and metadata RPC batching
Build tenant isolation into the storage layer, including quota enforcement, blast-radius containment, and noisy-neighbor mitigation
Own the storage side of sandbox startup and resume performance
Build durable block storage for sandboxes alongside other Baseten storage teams
Build observability into every layer, drive storage incidents end to end, and turn each one into a permanent fix
Contribute upstream to the open-source storage projects we build on
REQUIREMENTS
Strong systems programming background in Go, Rust, and/or C/C++, with comfort reading kernel code
Deep understanding of Linux filesystem and storage internals: VFS, page cache, dentry and inode caches, FUSE, the block I/O stack, fsync semantics, and crash consistency
Hands-on experience building distributed storage systems, content-addressable storage, or large-scale caching infrastructure
Experience profiling I/O, memory, and RPC bottlenecks and optimizing tail latency in production
Ability to debug correctness bugs that only show up under concurrency or partial failure
You move fast and like owning a problem end to end on a small team
NICE TO HAVE
Experience with a distributed filesystem or object store such as JuiceFS, CephFS, or S3-compatible storage, or contributions to those projects
Knowledge of consensus and replication protocols (Raft, leader leases, quorum reads)
Experience with snapshot, clone, and copy-on-write filesystem features
Experience operating multi-tenant storage with hard isolation requirements
Familiarity with Linux performance tooling such as eBPF, io_uring, perf, ftrace, and blktrace
BENEFITS
Competitive compensation, including meaningful equity
(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
(U.S. only) Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Similar jobs
- VS

Senior Spacecraft Mission Software EngineerRecently posted Auto Apply
Varda Space Industries · El Segundo · Hybrid 🇺🇸
DockerFiberAnsible+4TechnologySalary not listed - VS

Senior Spacecraft Flight Software EngineerRecently posted Auto Apply
Varda Space Industries · El Segundo · Hybrid 🇺🇸
FiberRustEmbedded Systems+3TechnologySalary not listed - VS

Senior Spacecraft Embedded Software EngineerRecently posted Auto Apply
Varda Space Industries · El Segundo · Hybrid 🇺🇸
FiberRustC+++2TechnologySalary not listed - SA

Senior / Staff Software Engineer — Product (Backend-Focused)Recently posted Auto Apply
Snorkel AI · San Francisco · Hybrid 🇺🇸
RustC++Java+1TechnologySalary not listed - BA

Software Engineer, Networking (Agent Infra)Recently posted Auto Apply
Baseten · San Francisco · Hybrid 🇺🇸
Rust5GTCP/IP+6TechnologySalary not listed - BA

Software Engineer, Compute and IsolationRecently posted Auto Apply
Baseten · San Francisco · Hybrid 🇺🇸
RustC++Notion+2TechnologySalary not listed - MA

Sr/Staff Software Engineer - COB & SubrogateRecently posted Auto Apply
Machinify · Remote - US · Remote 🇺🇸
DockerGCPRust+7Technology$200k - $250k/yr - AS

Software Engineer, Workforce OperationsRecently posted Auto Apply
Assembledhq · United States · Remote 🇺🇸
SalesforceTechnologySalary not listed - AT

Mission Operations EngineerRecently posted Auto Apply
Apex Technology Inc · Los Angeles · On-site 🇺🇸
RustC++Python+1TechnologySalary not listed - KL

Lead Integrations Engineer - G&A SystemsRecently posted Auto Apply
Klaviyo · San Francisco · Hybrid 🇺🇸
OnboardingOracleSQL+10EngineeringSalary not listed - KL

Lead Integrations Engineer - G&A SystemsRecently posted Auto Apply
Klaviyo · Boston · Hybrid 🇺🇸
OnboardingOracleSQL+10EngineeringSalary not listed - OP

Software Engineer, Physical EngineeringRecently posted Auto Apply
Openai · San Francisco · Hybrid 🇺🇸
Background ChecksCADCompliance+2TechnologySalary not listed