Quick overview
Job description
About the Role
Join a healthtech team developing clinician-facing decision support for Canadian public healthcare. You will build reinforcement learning environments and evaluations that help make clinical AI systems more reliable, working closely with researchers and clinicians who validate the outputs.
What You'll Do
Build reinforcement learning environments for complex clinical reasoning, including multi-step tasks, tool use, state transitions, and measurable success criteria.
Design and calibrate reward functions, grading rubrics, and LLM judges, and test them for reward hacking and misleading scores.
Own task design, data creation, environment implementation, evaluation, and delivery to model-training teams.
Run post-training and agent evaluation experiments, then use failures to improve the environments.
Collaborate with clinicians and research leaders to validate model outputs and evaluation quality.
What We're Looking For
A PhD in computer science, machine learning, or a related field, or at least three years of full-time reinforcement learning research or post-training experience. Candidates should have at least three years of research or industry experience, or be a final-year PhD student or postdoctoral researcher.
A bachelor's degree or higher in computer science, machine learning, mathematics, or a related technical field.
Hands-on experience building reinforcement learning environments, post-training systems, or agent evaluations, along with production-level experience using Python, PyTorch, and Transformer models.
Experience owning reward functions, grading rubrics, or LLM judge calibration, and clearly documenting failed experiments and uncertainty.
Strong research depth, experience in a frontier AI lab or leading AI company, comfort with ambiguity and cross-disciplinary work, and care in validating plausible model outputs.
Clinical AI experience is useful, as is knowledge of information retrieval design, constraint solving, SAT/SMT, or domain-specific languages.
Compensation & Benefits
Base salary: $250,000 to $400,000 annually. Visa sponsorship is not available. Candidates must already be authorized to work in Canada or the United States.
Location
Remote, with Montreal, Quebec, Canada as the primary location. The role is open to candidates working remotely in Canada or the United States.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- SA

Staff Machine Learning Engineer - Medical DevicesRecently posted Auto Apply
Sandboxaq · Canada · Remote · Posted 16 Nov 2026 🇨🇦
SQLAWSNumPy+8TechnologySalary not listed - PF
Scientifique IA/ML | Scientist, AI/MLRecently posted Auto Apply
Power Factors · Montreal, Quebec · Hybrid · Posted 13 Nov 2026 🇨🇦
DroneSCADALLM+5TechnologySalary not listed - HE

Staff Machine Learning Engineer, AdTechRecently posted Auto Apply
HelloFresh · Toronto · Hybrid · Posted 17 Nov 2026 🇨🇦
DockerFastAPISQL+13TechnologySalary not listed - NA

Director, Machine Learning Auto Apply
Narvar · Remote - Canada · Remote · Posted 10 Nov 2026 🇨🇦
GCPAirflowCAD+4TechnologyC$240k/yr - UR
AI/ML Engineer Auto Apply
Urban Ridge Supplies · Toronto · On-site 🇨🇦
DockerAWSETL+12TechnologySalary not listed - UR
Forward Deployed Engineer (Data, ML & AI) Auto Apply
Urban Ridge Supplies · Toronto · On-site 🇨🇦
DockerRustSQL+29C$160k - C$180k/yr - UR
AI Inference Engineer Auto Apply
Urban Ridge Supplies · Toronto · On-site 🇨🇦
DockerContinuous ImprovementCustomer Success+3C$165k - C$330k/yr - UR
Lead, AI/Machine Learning Engineer Auto Apply
Urban Ridge Supplies · Toronto · On-site 🇨🇦
RecruitingWorkdayDocker+21TechnologyC$86k - C$130k/yr - UR
Machine Learning Engineer, Lyft Business & Ads Auto Apply
Urban Ridge Supplies · Toronto · On-site 🇨🇦
AWSCADLLM+7TechnologyC$148.5k/yr - UR
Machine Learning Engineer Auto Apply
Urban Ridge Supplies · Toronto · On-site 🇨🇦
GitMLOpsMLflow+6TechnologyC$210k - C$224k/yr - WS
Senior Machine Learning Engineer Auto Apply
Wiser Solutions · Toronto, ON · Remote · Posted 6 Nov 2026 🇨🇦
CADGenerative AITechnologyC$160k - C$200k/yr - FL
Senior MLOps Engineer (Real-Time Decisioning) Auto Apply
Fluent, LLC · Toronto, Ontario · Remote · Posted 5 Nov 2026 🇨🇦
SQLApache SparkAWS+10EngineeringC$130k - C$140k/yr