Quick overview
Job description
ABOUT THE COMPANY
We're building autonomous research agents for recursive self-improvement (multi-agent systems that propose, run, and analyze machine learning experiments). We're a small, well-funded team that works onsite in San Francisco.
ABOUT THE ROLE
You'll write and optimize the GPU kernels and supporting systems software that makes our training and inference workloads fast. This is deep, low-level work (performance counters, memory bandwidth, warp-level scheduling) applied to the specific shapes and patterns our models actually use.
We hire kernel engineers because the gap between "this works" and "this is fast on the hardware we have" is enormous, and that gap directly bounds what our researchers can try. You'll close that gap.
WHAT YOU'LL DO
Write and optimize GPU kernels (CUDA, ROCm, Triton, or similar) for training and inference workloads: attention variants, MoE layers, custom activations, communication primitives
Profile real workloads with hardware counters and translate findings into specific kernel-level optimizations
Co-design kernels with the research teams, when the kernel and the algorithm need to change together, you participate in both
Integrate optimized kernels into our training and serving stacks; benchmark before and after; verify the win is real end-to-end
Maintain kernel quality over time as hardware, frameworks, and workloads shift underneath
Spread kernel-level fluency across the team; we want this expertise shared, not siloed
WHAT WE'RE LOOKING FOR
4+ years writing performant GPU kernels (CUDA, ROCm, Triton, or production-grade equivalent)
Hardware-level fluency: memory hierarchy, occupancy, register pressure, tensor cores, warp scheduling
Profiling fluency (Nsight, ncu, or comparable tools) and the discipline to measure before changing
Track record of shipping kernel-level optimizations that moved a measurable metric in a real system
Strong systems expertise: you understand how kernels live inside larger frameworks and how integration choices affect end-to-end performance
Comfortable reading framework-level Python and C++ around your kernels
NICE TO HAVE
Open-source contributions to kernel libraries, compilers, or ML frameworks
Experience with multiple accelerator architectures (different GPU families, TPUs, custom ASICs), preferably AMD GPUs
Familiarity with collective communication primitives (NCCL or equivalent)
Compiler or runtime background
THIS ROLE IS PROBABLY NOT FOR YOU IF
You haven't gotten your hands dirty at the kernel level: this isn't a higher-level systems role rebranded
You want to stay narrowly in one library; we expect breadth across the kernel surface our models actually use
Performance work without measurable end-to-end impact frustrates you
SPONSORSHIP SUPPORT
We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- SC
Principal Software Engineer - Deployment Environments LeadRecently posted Auto Apply
SciTec · Dayton, Ohio · On-site · Posted 20 Nov 2026 🇺🇸
DockerGitAWS+16Technology$151k - $201k/yr - SC
Principal Software Engineer - Deployment Environments LeadRecently posted Auto Apply
SciTec · Huntsville, Alabama · On-site · Posted 20 Nov 2026 🇺🇸
DockerGitAWS+16Technology$151k - $201k/yr - VE

Senior Embedded Engineer - IntercomRecently posted Auto Apply
Verkada · San Mateo · Hybrid · Posted 21 Nov 2026 🇺🇸
BashC++HTTP+3Technology$200k - $300k/yr - VE

Staff Embedded Engineer - IntercomRecently posted Auto Apply
Verkada · San Mateo · Hybrid · Posted 21 Nov 2026 🇺🇸
C++HTTPIntercom+2Technology$210k - $300k/yr - SP

Software Engineer, Development Test (Starlink)Recently posted Auto Apply
SpaceX · Redmond · Hybrid · Posted 20 Nov 2026 🇺🇸
TCP/IPAssemblyCompliance+6Technology$125k - $165k/yr - SP

Software Engineer, SimulationRecently posted Auto Apply
SpaceX · Hawthorne · Hybrid · Posted 20 Nov 2026 🇺🇸
FastAPIFlaskSQL+13Technology$125k - $160k/yr - SP

Software EngineerRecently posted Auto Apply
SpaceX · Cape Canaveral · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerSQLScala+17TechnologySalary not listed - SP

Application Software Engineer, Applied AIRecently posted Auto Apply
SpaceX · Hawthorne · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerSQLScala+11Technology$125k - $160k/yr - SA

Staff or Senior Firmware Engineer Auto Apply
Samsara · SF Bay Area · Remote · Posted 10 Nov 2026 🇺🇸
AWSEmbedded SystemsFleet Management+7Technology$162.4k - $290k/yr - PA

Expert: Interactive Coding, Financial Crime (Contract, Remote)Recently posted Auto Apply
Patronus AI, Inc. · United States · Remote · Posted 21 Nov 2026 🇺🇸
OnboardingCase ManagementGreenhouse+1Finance$150/hr - PA

Expert: Interactive Coding, Core Banking (Contract, Remote)Recently posted Auto Apply
Patronus AI, Inc. · United States · Remote · Posted 21 Nov 2026 🇺🇸
OnboardingGreenhouseReconciliationFinance$150/hr - PA

Expert: Interactive Coding, Video Streaming (Contract, Remote)Recently posted Auto Apply
Patronus AI, Inc. · United States · Remote · Posted 21 Nov 2026 🇺🇸
OnboardingCDNGreenhouse$150/hr