Quick overview
Job description
About Us
Our mission is to raise AGI with the richness of human intelligence — curious, witty, imaginative, and full of unexpected brilliance.
Surge was founded by engineers and researchers who dreamed of building the next generation of AI. Our platform powers the most capable models in the world, in partnership with the AI models you use every day.
At Surge, we believe the path to AGI isn't just about scaling compute—it's about embracing the unlimited ceiling of human intelligence and creativity in the data that shapes these systems. Our platform combines elite human expertise with cutting-edge tools for scalable oversight, from building rich RL environments to conducting rigorous evaluations that go beyond benchmarks. We've run a profitable business from day one without raising venture funding.
The Role
As a Software Engineer, Coding Evaluation & Training Data at Surge, you'll sit at the intersection of software engineering and product to build and run the systems that teach frontier models how to code.
You’ll own end-to-end coding data projects for top AI labs, designing tasks, RL environments, and evaluation schemes that reflect real-world software engineering. This is an ideal role for a software engineer who wants to keep using their engineering skill set every day, but is most excited by training data quality, agentic evaluation, and system design (humans + models + tools) rather than traditional product feature work.
What You'll Do
Own end-to-end coding data projects, from initial scoping and pilot design through execution, iteration, and scale-up.
Design agentic training workflows and task structures that mirror real-world SWE work (e.g., refactoring, debugging, code review, large-repo navigation, tool use).
Define and iterate on rubrics, golden sets, and reward signals that capture true engineering value, not just “does it compile.”
Evaluate data and worker output with strong SWE taste, and make calls about what meets the bar for frontier training.
Design and run qualification processes for coding workers, including hands-on assessments of their coding ability.
Set up or partner on complex technical environments (e.g., containers, repos, test harnesses, sandboxes, code execution infrastructure).
Partner with technical staff at our clients to translate high-level training goals into concrete projects and technical environments.
Collaborate closely with Surge engineering, product, and operations to improve our coding data products, internal tools, and execution processes.
What We're Looking For
2–6+ years of professional software engineering experience building and maintaining real systems.
Strong coding ability in at least one mainstream language and comfort working in production codebases.
High “taste” for good engineering: you care about correctness, code quality, and how real engineering teams actually work.
Ability to reason about and debug technical environments, including containers, dependencies, and automated test setups.
Interest in owning projects end-to-end, including scoping, workflow design, execution, and continuous improvement.
Excellent written and verbal communication skills, with the ability to speak credibly with senior client engineers and translate fuzzy goals into actionable plans.
Excitement about AI/ML systems and the role of data, evaluation, and reward design in improving agentic coding capabilities.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- SP
Software Engineer, Super IntelligenceRecently posted Auto Apply
SpaceXSI · Palo Alto · Hybrid · Posted 16 Nov 2026 🇺🇸
RustTCP/IPC+++1Technology$140k - $225k/yr - AU

Sr. Robotic Software EngineerRecently posted Auto Apply
Aureliussystems · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
RoboticsC++Python+1TechnologySalary not listed - AU

Principal Robotic Software EngineerRecently posted Auto Apply
Aureliussystems · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
RustRoboticsC+++1TechnologySalary not listed - CL

Sr. Software Engineer - Enterprise Features & OrchestrationRecently posted Auto Apply
Clickhouse · Europe or US · Remote · Posted 16 Nov 2026 🇺🇸
GCPMongoDBAWS+12TechnologySalary not listed - PV

Sr. Forward Deployed Engineer (FDE)Recently posted Auto Apply
PVM, Inc. · Colorado Springs - ONSITE · Hybrid · Posted 16 Nov 2026 🇺🇸
EchoJavaPython+3EngineeringSalary not listed - TT
Founding Senior EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 16 Nov 2026 🇺🇸
LLMPythonTypeScript+1Engineering$175k - $225k/yr - TT
Robotics Software EngineerRecently posted Auto Apply
True Talent Solutions Partners · Watertown · On-site · Posted 16 Nov 2026 🇺🇸
DockerEmbedded SystemsRobotics+6Technology$130k - $180k/yr - TT
Forward Deployed Infrastructure EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
DockerGCPAWS+6Technology$200k - $300k/yr - TT
Senior/Staff Software EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 16 Nov 2026 🇺🇸
RustAWSERP+5Technology$180k - $270k/yr - TT
Senior Forward Deployed Engineer, OperateRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 16 Nov 2026 🇺🇸
GCPNext.jsAWS+15Engineering$170k - $205k/yr - TT
Senior Software Engineer, Distributed Systems (Core)Recently posted Auto Apply
True Talent Solutions Partners · Remote · Remote · Posted 16 Nov 2026 🇺🇸
DockerSQLFlink+2Technology$180k - $320k/yr - TT
Software Engineer, C++ SystemsRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
RustC++Kubernetes+1Technology$250k - $325k/yr
