Quick overview
Job description
At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructure, next-generation UIs, and frontier deep learning research.
Who we are
We are scientists, engineers, and builders from the industry's top tech companies and AI labs. We bring a proven track record of scaling consumer systems for hundreds of millions of users and architecting the pre-training infrastructure behind today's frontier models.
About the Role
We are looking for exceptional systems engineers to build the high-performance engines that train our models. Your goal is to make training at River fast, reliable, and massively scalable.
You will take ownership of our core infrastructure stack; from writing custom GPU kernels to managing clusters of thousands of nodes, ensuring our researchers can focus on science rather than system bottlenecks.
What You’ll Do
- Architect and deploy fault-tolerant distributed systems for training and inference workloads across clusters with thousands of nodes.
- Design high-performance kernels to maximize tensor operation efficiency, memory throughput, and networking over InfiniBand/RDMA.
- Profile systems end-to-end to resolve blockers across hardware, software, data loading pipelines, and collective communication primitives.
- Partner directly with research scientists to rapidly implement, optimize, and scale experimental model architectures.
Skills & Qualifications
Minimum Qualifications:
- Bachelor’s degree in Computer Science, Computer Engineering, or equivalent practical industry experience.
- Deep expertise in systems-level languages (C, C++, or Rust) with a track record of writing performant, maintainable code.
- Strong foundation in computer architecture, memory management, and concurrent programming.
- Exceptional debugging skills, especially when tackling complex, non-deterministic issues in distributed environments.
- A highly collaborative mindset and a bias for action to push boundaries across the stack.
Preferred Qualifications: (We encourage you to apply even if you don't meet all of these)
- Hands-on experience with modern AI frameworks (e.g., PyTorch, JAX) and tooling for large-scale model training.
- Deep familiarity with modern GPU architectures (NVIDIA/AMD) and hardware constraints (HBM bandwidth, PCIe limits).
- A proven track record of shipping and maintaining high-performance distributed systems or low-level software libraries.
Logistics & Benefits
- Location: Palo Alto, California.
- Compensation: Depending on experience and skills the expected base pay is $200,000 - $420,000 USD per year, plus equity.
- Benefits: Comprehensive health, dental, and vision insurance; unlimited PTO; and relocation assistance as needed.
- Visa Sponsorship: We sponsor visas and are committed to supporting the process for the right candidate.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- TT
Product EngineerRecently posted Auto Apply
True Talent Solutions Partners · Palo Alto · On-site · Posted 17 Nov 2026 🇺🇸
SQLAmplitudeMixpanel+4$185k - $205k/yr - TT
Software Engineer, C++ SystemsRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 17 Nov 2026 🇺🇸
RustC++Kubernetes+1Technology$250k - $325k/yr - TT
Senior Forward Deployed Engineer, OperateRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 17 Nov 2026 🇺🇸
GCPNext.jsApache Spark+14Engineering$170k - $205k/yr - TT
Lead Product EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 17 Nov 2026 🇺🇸
SourcingNext.jsFigma+1$225k - $275k/yr - TT
Founding Forward Deployed EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 17 Nov 2026 🇺🇸
OnboardingSQLPython+1Engineering$180k - $250k/yr - TG
Senior Software Engineer - Austin, TXRecently posted Auto Apply
TeamViewer Germany GmbH · Austin · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionOnboardingDocker+12TechnologySalary not listed - HA

Forward Deployed EngineerRecently posted Auto Apply
Hume Ai · Hume AI HQ · On-site · Posted 17 Nov 2026 🇺🇸
PythonTypeScriptEngineeringSalary not listed - RA
Software and Controls Team LeadRecently posted Auto Apply
Rai · Cambridge · On-site · Posted 17 Nov 2026 🇺🇸
GitRoboticsC+++3Technology$200.2k - $371.8k/yr - RA
Sr. Simulation EngineerRecently posted Auto Apply
Rai · Cambridge · On-site · Posted 17 Nov 2026 🇺🇸
DockerGitRobotics+6Engineering$175.6k - $371.8k/yr - RA
Sr. Build EngineerRecently posted Auto Apply
Rai · Cambridge · On-site · Posted 17 Nov 2026 🇺🇸
GitEmbedded SystemsRobotics+6Engineering$175.6k - $371.8k/yr - RA
Robotics Software Engineer Interactive MobilityRecently posted Auto Apply
Rai · Cambridge · On-site · Posted 17 Nov 2026 🇺🇸
GitRoboticsC+++4Technology$140.9k - $261.3k/yr - RA
Senior Software Engineer Interactive MobilityRecently posted Auto Apply
Rai · Cambridge · On-site · Posted 17 Nov 2026 🇺🇸
DockerGitRobotics+8Technology$178.5k - $326.0k/yr
