Why This Role Stands Out
You'll have the opportunity to build cutting-edge, high-performance kernels for AGI research, significantly impacting the future of AI while developing deep expertise in optimization and low-level programming. This role is ideal for experienced kernel engineers who thrive on complex challenges and want to contribute to a mission-driven company with a highly competitive compensation package. Apply now to join a team at the forefront of technological advancement!
Quick Overview
Job Description
Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.
About the role
As a Kernel Engineer, you will design, implement, and maintain high-performance kernels to optimize throughput and latency during training and inference.
Magic's long-context windows create distinct kernel optimization challenges around memory utilization, data movement, and sustained throughput.
What you'll work on
Design and implement kernels that support high-performance long-context behavior
Ownership of kernel design, implementation, deployment, and production reliability
Focus on robustness, extensive testing, and functional correctness, while pushing on performance
Evaluate porting Magic’s compute kernels to alternative hardware options
Co-design kernels with understanding and interaction with training, inference, and RL teams
For a sample of our work, see Magic-Attention, presented at GTC 2026
What we’re looking for
Low-level programming experience targeting AI accelerators such as NVIDIA Blackwell or Google TPUs
Develop and optimize GPU kernels in frameworks such as NCCL, MSCCLPP, CUTLASS, CuTeDSL, Triton, Quack, Flash-Attention, and similar frameworks
Experience in other kernel authoring frameworks such as Pallas/Mosaic (GPU or TPU), or Mojo also maps well to the work on Magic's kernel team
Strong depth over shallow breadth: for kernel engineering, we prefer candidates with deep expertise in computer architecture, low-level machine optimizations, and code generation, with breadth across ML
Agility, ownership mindset, and grit
Our culture
Integrity. Words and actions should be aligned
Hands-on. At Magic, everyone is building
Teamwork. We move as one team, not N individuals
Focus. Safely deploy AGI. Everything else is noise
Quality. Magic should feel like magic
Magic strives to be the place where high-potential individuals can do their best work. We value quick learning and grit just as much as skill and experience.
Compensation, benefits and perks (US)
Annual salary ranges between $275K - $550K based on experience
Equity is a significant part of total compensation, in addition to salary
401(k) plan with 6% salary matching
Generous health, dental and vision insurance for you and your dependents
Unlimited paid time off
Visa sponsorship and relocation stipend to bring you to SF, if possible
A small, fast-paced, highly focused team
Similar jobs
- CI
Software Developer
NewCACI International, Inc.
NC🇺🇸$71.5k - $150.2k/yrHybrid12 hours agoOracleSQLSQL Server+8Technology - CI
Engineer
NewCACI International, Inc.
Crane, IN🇺🇸$62.2k - $127.3k/yrHybrid12 hours agoEngineering - OR
Principal Software Engineer
NewOracle
Nashville, Tennessee🇺🇸$114.6k - $234.6k/yrHybrid3 minutes agoDockerOracleShell+6Technology - JM
Senior Lead Software Engineer
NewJ.P. Morgan
Jersey City, New Jersey🇺🇸On-site3 minutes agoRustAgileGo+1Technology - JM
Software Engineer III
NewJ.P. Morgan
Columbus, Ohio🇺🇸On-site3 minutes agoGCPMicroservicesSpring+8Technology - CT
Senior AI Software Developer with Security Clearance
NewClearBridge Technology Group
Southern Md Facility, MD🇺🇸$63 - $91/hrHybrid12 hours agoDockerMicroservicesAWS+6Technology