Why This Role Stands Out
This role offers a unique opportunity to directly influence the development of cutting-edge AI by shaping the data that trains powerful models. You'll thrive here if you're a creative problem-solver who enjoys rigorous testing and driving measurable improvements in a fast-paced, talent-dense environment. Apply to be at the forefront of automating code and building the future of programming tools.
Quick Overview
Job Description
Our mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design, and engineering. Our organization is very flat, and our team is small and talent dense. We particularly like people who are truth-seeking, passionate, and creative. We enjoy spirited debate, crazy ideas, and shipping code.
Software Engineer, RL Data
About the Role
The data behind a model shapes it more than almost anything else. On the RL Data team at SpaceXAI, you decide what that data is for our agents: which problems they practice, what world they practice in, and how they're judged. You'll take a weakness, like an agent that gives up on hard bugs or misuses a calendar API, and turn it into training data that fixes it, then show the next model is measurably better.
You form hypotheses about why data is helping or misleading the model, build the systems to test them, run ablations, and read the rollouts to find the bug, shortcut or mismatch behind a result. Every flaw you catch, or miss, shows up in what the next Grok models learn.
What you’ll work on
Turning a capability gap into thousands of verifiable tasks — for example, planting subtle bugs deep in a real project's dependencies for the agent to root-cause.
Building environments that behave like production: real codebases with their real dependencies, and simulations of apps like email, calendar, and docs that match the real ones down to search, errors, and pagination.
Designing graders for open-ended work that separate good solutions from bad without penalizing valid alternatives or rewarding shortcuts.
Building automated checks that catch reward hacking, leaked answers, broken environments, and paths the real product wouldn't allow, before data reaches training.
Scaling from a thousand hand-checked tasks to millions, with filters and judges you can trust in place of a person reading each one
You may be a fit if
You have strong software engineering fundamentals, and you've built non-trivial systems in Python: data pipelines, test or eval infrastructure, sandboxes, or backend services.
You have taste for what makes an environment trustworthy: faithful enough that skills transfer, strict enough that shortcuts fail, and simple enough to debug when a result looks wrong.
You are careful and systematic — understanding both aggregate metrics and close reading of raw outputs.
You enjoy turning messy, open-ended problems into repeatable, high-quality data production systems.
RL or ML experience is a plus but not required. We welcome strong engineers who want to do research on what makes models better.
Applying
If there appears to be a fit, we'll reach out to schedule 2-3 short technicals. After, we'll schedule an onsite in our office, where you'll work on a small project, discuss ideas, and meet the team.
Similar jobs
- MG
Senior Java Engineer
NewAuto ApplyMan Group
Massachusetts🇺🇸$150k - $170k/yrOn-site19 hours agoDockerMicroservicesMongoDB+28Technology - SE
Software Development Engineer II
NewAuto ApplySeated
New York🇺🇸On-site10 hours agoDockerGCPMicroservices+8Technology - DS
(1116018) Software Engineer - C++ Autonomy & Robotics
NewAuto ApplyDiversified Services Network, Inc.
Peoria, Illinois🇺🇸On-site12 hours agoRoboticsC++Technology - C-
Principal Software Engineer - Backend & AI Infra
NewAuto ApplyCVector - Industrial AI
New York🇺🇸On-site5 hours agoSupabaseAWSPostgreSQL+2Technology - BI
Applications Engineering Specialist (BOS USA) - Hybrid
NewAuto ApplyBOS Innovations
Lexington, Kentucky🇺🇸Hybrid7 hours agoEstimatingMechanical DesignSolidWorksEngineering - AE
Automation Engineer - EPMS Design
NewAuto ApplyAlbireo Energy
Edison, New Jersey🇺🇸Hybrid7 hours agoAssemblyAutoCADBIM+3Technology - AE
Automation Engineer - EPMS Design
NewAuto ApplyAlbireo Energy
Atlanta, Georgia🇺🇸Hybrid7 hours agoAssemblyAutoCADBIM+3Technology - PE
Silicon Design Engineer
NewAuto ApplyPersimmons
San Jose, California🇺🇸Hybrid10 hours agoVerilogEngineering - AE
Automation Engineer - EPMS Design
NewAuto ApplyAlbireo Energy
Gambrills, Maryland🇺🇸Hybrid12 hours agoAssemblyAutoCADBIM+3Technology - LP
Cleared Network Engineer (Cisco ACI) - TS/SCI w/ Poly
NewAuto ApplyLeading Path Consulting
McLean, Virginia🇺🇸On-site7 hours agoAnsibleChefPuppet+3Technology - LP
Cleared Network Engineer (Cisco ACI) - TS/SCI w/ Poly
NewAuto ApplyLeading Path Consulting
Warrenton, Virginia🇺🇸On-site7 hours agoAnsibleChefPuppet+3Technology - LA
Database Administrator Engineer
NewAuto ApplyLaBella Associates
Orange, Connecticut🇺🇸On-site7 hours agoPerformance ManagementRecruitingTechnology