Quick overview
Job description
About The Role
Your day-to-day activities will include building and maintaining cybersecurity benchmarks, hardening the sandboxes they run in, and keeping our benchmarks running so we can evaluate new model releases quickly. An ideal candidate for this role might have a background in red teaming and sandboxing software, alongside strong software engineering experience and hands-on familiarity with AI coding harnesses. Your work will be key to giving researchers, developers and policymakers an independent, rigorous picture of what AI can do in cybersecurity.
Practicalities
Location: Fully remote. We are able to hire in many countries.
Work Hours: Full-time, flexible. We prefer candidates who can overlap with UTC–8 (Pacific Time) and UTC (Greenwich Mean Time).
Travel Requirement: None required. We prefer candidates who can travel to our three retreats per year.
Compensation: $150,000 to $350,000
Application Deadline: Applications are reviewed on a rolling basis
Start Date: As soon as selected candidate is available
Reports to: CTO
What You’ll Own
- Design, build and maintain cybersecurity benchmarks for AI within our evaluation infrastructure, primarily using the Inspect library
- Pitch and prototype your own ideas for new benchmarks and experiments
- Keep the suite running so we can evaluate new model releases quickly and painlessly Secure evaluation environments
- Sandbox and harden our evaluation environments so highly capable AI models cannot escape them
- Stay current on how AI agents and coding harnesses interact with their environments Evaluation strategy and threat modelling
- Use threat modelling to inform our benchmarking approach and decide what we measure
- Provide strategic input on our AI cybersecurity evaluation strategy Infrastructure and collaboration
- Integrate with AI providers and set up benchmarks to run on our infrastructure
- Work with researchers, analysts and other engineers to ensure evaluation data and outputs are accurate, insightful, and integrated into our research products and publications
About You
- Strong software engineering experience, including several years building and maintaining complex systems and regularly contributing robust, maintainable code
- Offensive security experience
- Familiarity with agentic AI use and coding harnesses
- Ideas and creativity: you can generate your own ideas for new benchmarks and experiments
- Motivation from Epoch AI’s mission to provide rigorous, independent insight into key trends in AI, including delivering public, trustworthy evaluations of AI capabilities Nice-to-haves
- Experience benchmarking AIs and running evaluations
- Experience setting up CTF infrastructure
- Experience sandboxing against highly capable adversaries
- Experience using modern AI for red teaming or ethically hacking
- Knowledge of the inner workings of AI coding harnesses and tool calls
- A solid grasp of current AI trends
Additional Information
Please submit all of your application materials in English and note that we require professional level English proficiency.
Please do not include a cover letter, photograph, or headshot of yourself, or any personal information that is not relevant to the role for which you're applying (including marital status, age, identity traits, etc.).
Epoch is committed to building an inclusive, equitable, and supportive community for you to thrive and do your best work. We’re committed to finding the best people for our team, so please don’t hesitate to apply for a role regardless of your age, gender identity/expression, political identity, personal preferences, physical abilities, veteran status, neurodiversity or any other background. Please email careers@epoch.ai if you have any questions about this role, accessibility requests, or if you want to request an extension to the application deadline. However, we will not review applications submitted to this email address; please submit your application through the link on this page.
Epoch AI is a research institute that investigates trends in machine learning and the economic consequences of AI. Our mission is to develop a comprehensive, publicly accessible knowledge base on AI that informs policymakers, industry leaders, and society at large.
We strive to achieve both rigor and accessibility to our work, as exemplified by some of our most successful projects, including our database of AI models and our AI trends dashboard. Our body of research includes our work on compute trends (IJCN 2022), data scarcity (ICML 2024), and algorithmic progress (NeurIPS 2024). You can read more about our work and mission on our website and in this Time profile.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- SA

Staff Software EngineerRecently posted Auto Apply
Samsara · United States · Remote · Posted 19 Nov 2026 🇺🇸
GraphQLIoTLLM+2Technology$154.7k/yr - NR

Associate Software Engineer - Java (Distributed Systems and Databases)Recently posted Auto Apply
New Relic · Portland · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerDynamoDBGCP+9Technology$98k - $123k/yr - KO

Software Engineer, Controls (C++)Recently posted Auto Apply
Kodiak · Mountain View · Hybrid · Posted 20 Nov 2026 🇺🇸
MATLABSpringAWS+4Technology$145k/yr - IN

Senior Software EngineerRecently posted Auto Apply
Instawork · San Francisco · Hybrid · Posted 19 Nov 2026 🇺🇸
DjangoRoboticsAngular+8Technology$170k - $200k/yr - ME

Product Engineer, Talent ExperienceRecently posted Auto Apply
Mercor · San Francisco · On-site · Posted 20 Nov 2026 🇺🇸
GitLLMMental Health+3Salary not listed - PA

Product EngineerRecently posted Auto Apply
Paradigmai · San Francisco · On-site · Posted 19 Nov 2026 🇺🇸
ZustandReactTypeScriptSalary not listed - UP

Senior Software EngineerRecently posted Auto Apply
Upstart · United States · Remote · Posted 19 Nov 2026 🇺🇸
Next.jsPrismaREST+3Technology$164.8k/yr - TO
Senior Software Engineer, Vision AIRecently posted Auto Apply
Toast · United States · Remote · Posted 19 Nov 2026 🇺🇸
AWSComputer VisionJava+6Technology$125k - $254k/yr - NA

Sr. Software Engineer, BackendRecently posted Auto Apply
Navan · New York · Hybrid · Posted 19 Nov 2026 🇺🇸
MicroservicesJavaKafka+4Technology$113.4k - $252k/yr - RO

Software Engineer, Enterprise BuildRecently posted Auto Apply
Robinhood · Menlo Park · Hybrid · Posted 19 Nov 2026 🇺🇸
GCPSSOLLM+1Technology$166k - $195k/yr - PI

Software Engineer Intern 2027 (USA) Auto Apply
Pinterest · San Francisco · Remote · Posted 6 Nov 2026 🇺🇸
GitC++Java+4Technology$8.3k - $11k/mo - EV

Technical Services Engineer, Portworx (Shift: Monday - Friday from 9:00 AM - 6:00 PM EST)Recently posted Auto Apply
Everpure · Raleigh · Hybrid · Posted 19 Nov 2026 🇺🇸
Engineering$122k/yr
