Quick overview
Job description
We are seeking physicians to review, validate and design clinical tasks to help advance frontier AI models across a range of clinical scenarios and formats.
The project is designed to surface where models perform poorly in clinical scenarios such missed findings, incorrect clinical information, overconfidence or failure to seek context before answering.
You will work asynchronously on a dedicated platform, within your own specialty and day-to-day scope of practice.
This is a remote, flexible and short-term project.
Key Responsibilities
Scenario Design: Design realistic clinical scenarios and instructions that mirror the work you carry out day-to-day in your specialty.
Content Review: Assess clinical outputs for accuracy, flagging anything incorrect, outdated or can cause harm.
Reference Answer Validation: Judge whether reference answers reflect what you would actually write in practice, including caveats, uncertainty and requests for further information.
Grading Criteria Assessment: Design and evaluate whether scoring criteria capture what matters clinically and whether each is weighted appropriately, particularly safety-critical items.
Written Rationale: Provide short, specific reasoning where you disagree, and note the weakness each new item is designed to expose.
Feedback & Continuous Improvement: Highlight edge cases and ambiguity to refine guidelines and improve consistency across reviewers.
Qualifications
Licensure: Registered doctor based in the US, Europe or Asia-Pacific.
Experience: Current or recent clinical practice in your stated specialty.
Knowledge: Strong grounding in current guidelines, diagnostic reasoning and clinical documentation standards.
Attention to detail: Proven accuracy and consistency in clinical review or assessment work.
Technical proficiency: Comfortable using structured review tools and digital platforms.
Language: Native or near-native written English.
Legal Status
You will have the right to work in your country of residence.
You will work as an independent contractor.
Why Join Us?
Flexible Work Arrangements: Part-time, remote and fully asynchronous.
Competitive Compensation: Hourly rate in line with specialty and level of experience.
Professional Development: Direct involvement in how frontier AI models are evaluated for clinical safety, working alongside clinicians and AI researchers.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- PO
Experienced Associate Dentist (NHS and Private) - Farsley Dental, PudseyRecently posted Auto Apply
PortmanDentex · Leeds · On-site · Posted 11 Nov 2026 🇬🇧
Patient CareHealthcareSalary not listed - PH

Private Resident Doctor in Oncology/Haematology - 20 mins from city centre ManchesterRecently posted Auto Apply
Pulse Healthcare · London · Hybrid · Posted 11 Nov 2026 🇬🇧
RecruitingHealthcare£87k/yr - DM

Consultant General Medicine - IpswichRecently posted Auto Apply
Direct Medics · Ipswich · On-site · Posted 11 Nov 2026 🇬🇧
RecruitingCompliancePayrollSalary not listed - DM

Obstetrics & Gynaecology Specialty Dr - Western TrustRecently posted Auto Apply
Direct Medics · Enniskillen · On-site · Posted 11 Nov 2026 🇬🇧
RecruitingCompliancePayrollSalary not listed - SH
Consultant Aesthetic Physician - UK /CCT (Leading Private healthcare facility)Recently posted Auto Apply
SearchPlus HR · London · On-site · Posted 11 Nov 2026 🇬🇧
ComplianceHealthcareSalary not listed - PH

Private GP & Health Screening Doctor Opportunities | London | Work-life balance & structured daysRecently posted Auto Apply
Pulse Healthcare · London · Hybrid · Posted 11 Nov 2026 🇬🇧
RecruitingOnboardingHealthcareSalary not listed - GP
Remote GP Auto Apply
Gpdq · United Kingdom · Remote 🇬🇧
Mental HealthSalary not listed - PH
Consultant Physician in Diabetes & EndocrinologyRecently posted Auto Apply
Portsmouth Hospitals University NHS Trust · Portsmouth · On-site · Posted 9 Nov 2026 🇬🇧
NursingHealthcareSalary not listed - FH

Senior Medical AdvisorRecently posted Auto Apply
Flo Health · London · Hybrid · Posted 11 Nov 2026 🇬🇧
Google WorkspaceFigmaMiro+1Healthcare£82k - £95k/yr - DM

SWAH Northern Ireland - Consultant - Anaesthetics & ICU - ASAPRecently posted Auto Apply
Direct Medics · Enniskillen · On-site · Posted 9 Nov 2026 🇬🇧
RecruitingCompliancePayrollSalary not listed - DM

CT2 Obstetrics & Gynaecology - Northern TrustRecently posted Auto Apply
Direct Medics · Coleraine · On-site · Posted 9 Nov 2026 🇬🇧
RecruitingCompliancePayrollSalary not listed - DM

Consultant Anaesthetics - Colchester HospitalRecently posted Auto Apply
Direct Medics · Colchester · On-site · Posted 9 Nov 2026 🇬🇧
RecruitingCompliancePayrollHealthcareSalary not listed
