Quick overview
Job description
About Us
Our mission is to raise AGI with the richness of human intelligence — curious, witty, imaginative, and full of unexpected brilliance.
Surge was founded by engineers and researchers who dreamed of building the next generation of AI. Our platform powers the most capable models in the world, in partnership with the AI models you use every day.
At Surge, we believe the path to AGI isn't just about scaling compute—it's about embracing the unlimited ceiling of human intelligence and creativity in the data that shapes these systems. Our platform combines elite human expertise with cutting-edge tools for scalable oversight, from building rich RL environments to conducting rigorous evaluations that go beyond benchmarks. We've run a profitable business from day one without raising venture funding.
The Role
As an RL Environments Architect, you’ll design, instrument, and govern the simulated worlds where agents learn — from compact task microcosms to multi-agent, tool-using ecosystems. You’ll define the primitives, reward structures, interfaces, and telemetry that let us stress-test emerging capabilities while keeping training signals faithful, stable, and scalable.
Not only will you build environments, you’ll craft standards for data quality and reproducibility across large-scale agent gyms. This is a role for someone who sweats the details of simulation fidelity, thinks in terms of coverage and failure surfaces, and loves turning messy real-world phenomena into learnable curricula. Your work will form the backbone for safe, rapid progress in agentic systems.
What You'll Do
Architect a modular environment framework with clear APIs, curriculum scaffolds, and configurable reward/termination schemas
Establish quality bars: coverage metrics, invariance checks, and trace audits for environment outputs and agent experience buffers
Instrument rich telemetry for episode rollouts; mitigating reward hacking, mode collapse, and exploitable loopholes
Partner with researchers to translate real-world tasks into robust simulations, including synthetic data generators and evaluation suites
What We’re Looking for
Simulation & Systems Depth – Experience building RL environments or simulators (e.g., custom physics, multi-agent, tool APIs) with an eye for determinism, performance, and observability
Data Quality Leadership – Strong instincts for designing reward functions, scenario taxonomies, and QA pipelines that keep signals aligned and drift-free
Builder’s Mindset – Comfort collaborating across research and engineering to ship pragmatic, testable environments that evolve with model capabilities
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- TU

AI Engineer – Manufacturing & ProductionRecently posted Auto Apply
Tutorintelligence · Watertown · On-site · Posted 16 Nov 2026 🇺🇸
SQLRoboticsCAD+5Manufacturing$150k - $190k/yr - TT
Founding AI Agent EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
RecruitingClinical TrialsOutreach+2$150k - $220k/yr - TT
AI SchedulerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
BIMConstruction ManagementPrimavera P6+2$140k - $200k/yr - TT
Founding AI EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 15 Nov 2026 🇺🇸
Next.jsPlaywrightNode.js+1Technology$216k - $250k/yr - ER

Head of Applied AI Auto Apply
Eragon · San Francisco · On-site · Posted 30 Oct 2026 🇺🇸
$350k - $500k/yr - OR
Research Engineer, AIRecently posted Auto Apply
Orbis · Remote - US · Remote · Posted 13 Nov 2026 🇺🇸
LLMPythonMachine LearningEngineeringSalary not listed - OR
Research Engineer, AI (Entry-Level) Auto Apply
Orbis · Remote - US · Remote · Posted 3 Nov 2026 🇺🇸
DockerLLMPython+2Salary not listed - WI
AI Value Delivery Lead (Partner Motion) Auto Apply
Within.ai · San Francisco (HQ) · On-site 🇺🇸
Six SigmaGenerative AISlackOperations & Project ManagementSalary not listed - SI
AI Transformation ManagerRecently posted Auto Apply
Sia · Bellevue, WA · On-site · Posted 13 Nov 2026 🇺🇸
ScrumLean Six SigmaPMP+5Operations & Project Management$142.8k - $147.9k/yr - SI
AI Transformation ManagerRecently posted Auto Apply
Sia · Philadelphia, PA · On-site · Posted 13 Nov 2026 🇺🇸
ScrumLean Six SigmaPMP+5Operations & Project Management$129.5k - $134.6k/yr - CO

Senior AI Engineer - Agentic Systems - OnsiteRecently posted Auto Apply
Conifers.ai · Dallas · Hybrid · Posted 15 Nov 2026 🇺🇸
LLMPythonPrompt EngineeringTechnologySalary not listed - CL

Mid-Level AI EngineerRecently posted Auto Apply
Clera · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
GCPAWSCompliance+7Technology$150k - $180k/yr
