Quick overview
Job description
Application deadline: We are conducting interviews actively and aim to fill this role as soon as we find someone suitable.
ABOUT THE OPPORTUNITY
The OpenAI/Hugging Face incident may be the biggest warning shot we get before catastrophic loss-of-control. In its aftermath, Anthropic and OpenAI committed to giving embedded evaluators an unprecedented level of access.
Embedded evaluations are the best existing method to find out whether alignment is on track. With OpenAI predicting an automated researcher by March 2028, we don't have time to start with an MVP embedded evaluation and iteratively improve it. The first embedded evaluations will set the standard and we have to get it right.
As a fundamental researcher, your ground-breaking discoveries will make our embedded evaluations better. For example, our fundamental science team's paper “Measuring Reward-Seeking via Contrastive Belief Updates” can be adapted by embedded evaluators. We want more breakthroughs like this.
We are also developing a “Science of Scheming”. The goal is ambitious and we’re looking for Research Scientists and Research Engineers who are excited to build a new hard science from the ground up.
Similar jobs
- AP

Lead Research Scientist/Engineer (Embedded Evaluations)Recently posted Auto Apply
Apolloresearch · London & San Francisco · On-site 🇬🇧
Hugging FaceGenerative AIEngineeringSalary not listed - O-
Graduate Quantitative Researcher 2028 – Expression of InterestRecently posted Auto Apply
Optiver - NeurIPS · Amsterdam · Hybrid 🇬🇧
OnboardingLinearContinuous Improvement+7Salary not listed - LG
Senior Analytical Scientist - LC-MS/MS & Method DevelopmentRecently posted Auto Apply
LGC Group · Fordham · On-site 🇬🇧
Continuous ImprovementSalary not listed - NB
Junior Quantitative Researcher, Commodities and Cross AssetRecently posted Auto Apply
Neuberger Berman · London · On-site 🇬🇧
Due DiligenceFixed IncomePythonSalary not listed - MG
Quant Researcher - Macro ; Futures / FXRecently posted Auto Apply
Man Group · London · On-site 🇬🇧
PythonSalary not listed - LC

Research Consultant (Real Assets)Recently posted Auto Apply
Lane Clark & Peacock · London · Hybrid 🇬🇧
Applicant Tracking SystemsMicrosoft ExcelDue Diligence+1Salary not listed - IN
AMO Physicist - Inertial SensingRecently posted Auto Apply
Infleqtion · Kidlington · Hybrid 🇬🇧
Stakeholder ManagementMicrosoft OfficeAltium+3Salary not listed - SA
Safety Research Scholar - Human Frontier LabsRecently posted Auto Apply
Scale AI · Canada; United Kingdom; United States · Hybrid 🇬🇧
OnboardingAuditingLLMSalary not listed - AN

Anthropic Research ResidentRecently posted Auto Apply
Anthropic · London · Hybrid 🇬🇧
NLPRoboticsConcrete+4Salary not listed - FA

Principal Research Scientist - AI Safety Auto Apply
Faculty · London · Hybrid 🇬🇧
RecruitingStakeholder ManagementPython+2Salary not listed - FA

Senior Research Scientist - AI Safety Evaluations Auto Apply
Faculty · London · Hybrid 🇬🇧
PythonGenerative AIMetaviewSalary not listed - FA

Senior Research Scientist - AI Safety Auto Apply
Faculty · London · Hybrid 🇬🇧
Deep LearningPyTorchPython+3Salary not listed