Research Engineer / Research Scientist, Vision-Language Model Pretraining
Why this role stands out
You'll drive groundbreaking advancements in AI for healthcare by leading the pretraining of state-of-the-art vision-language models using one of the industry's most comprehensive medical imaging datasets. This role offers immense growth potential for researchers passionate about multimodal AI and its direct impact on patient outcomes. Apply now to shape the future of medical diagnostics.
Quick overview
Job description
About Us
Epsilon Health is transforming medical imaging and diagnostics by bringing frontier AI into clinical practice. We're tackling some of healthcare's most critical challenges, building technology that directly improves patient outcomes.
This year, we've served over 300,000 patients and now serve 3,000+ daily, working with some of the largest medical institutions in the U.S. By year-end, we're on track to interpret 1% of all daily U.S. X-rays.
Our research team brings experience from DeepMind and Meta, powered by one of the industry's most comprehensive proprietary medical imaging datasets, continuously enriched by real-world clinical data. Together, we're building a future where frontier AI helps save millions of lives today, not tomorrow.
Recently out of stealth, we're proudly backed by Jack Altman, Uncork Capital, Renegade Partners, and AlleyCorp, one of NYC's most active healthcare venture firms.
About the Role
We're looking for an exceptional Research Scientist to push the frontier of vision-language models for medical imaging.
You'll own the pretraining of our multimodal foundation models, developing architectures and training methods that enable AI to understand complex medical images and generate clinically accurate radiology reports.
You'll tackle fundamental research challenges in multimodal learning, high-resolution visual understanding, and large-scale pretraining across X-rays, CT, and MRI.
Unlike traditional research labs, your work will draw on continuously growing real-world clinical data and help power models deployed into clinical practice, creating a direct feedback loop between research and patient care.
You'll work alongside a small team of researchers and engineers, with the freedom to pursue ambitious ideas and the resources to bring them to life. You'll collaborate closely with researchers responsible for post-training and reinforcement learning.
What You'll Do
Advance the frontier of multimodal AI. Design, pretrain, and scale vision-language foundation models for medical imaging.
Invent new architectures. Explore novel approaches to vision-language fusion, high-resolution image understanding, and efficient visual token representations.
Push the limits of pretraining. Develop multimodal training objectives, data mixtures, and scaling strategies across large-scale image-text datasets.
Solve visual grounding. Improve how models connect medical findings to specific regions, structures, and abnormalities within images.
Own research end to end. Take ideas from hypothesis and experimentation through large-scale distributed training, evaluation, and handoff to post-training.
Define how progress is measured. Develop rigorous evaluations for visual understanding, grounding, generalization, and downstream model performance.
Contribute to the research community. Publish original research, share technical insights, and help shape the direction of medical AI.
What We're Looking For
We care more about what you've built and discovered than where you've worked or how many years you've spent doing it.
Deep expertise in vision-language models, multimodal learning, or large-scale foundation model pretraining.
Demonstrated ability to develop, train, or improve state-of-the-art machine learning models.
Strong understanding of modern VLM architectures, multimodal training objectives, and vision-language alignment.
Experience with large-scale distributed training using PyTorch or JAX.
Ability to independently formulate research questions, design experiments, and turn promising ideas into working models.
Strong engineering skills and a track record of implementing and extending ideas from research.
A rigorous, experimental mindset and the ambition to solve difficult, unsolved problems.
Nice to Have
Publications at leading ML or computer vision conferences such as NeurIPS, ICML, ICLR, CVPR, or MICCAI.
Experience developing or scaling models such as LLaVA, Qwen-VL, InternVL, or similar multimodal architectures.
Experience training vision encoders or developing novel vision-language connector architectures.
Familiarity with high-resolution imaging, visual grounding, or 3D/volumetric data.
Experience with contrastive learning, generative pretraining, or large-scale multimodal data curation.
Background in medical imaging, radiology, or other scientific imaging applications.
Experience evaluating model factuality, interpretability, or reliability in high-stakes settings.
We welcome exceptional researchers from both academic and industry backgrounds. A traditional career path or prior healthcare experience is not required.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- DA

PhD GenAI Research Scientist InternRecently posted Auto Apply
Databricks · San Francisco · Hybrid · Posted 20 Nov 2026 🇺🇸
Microsoft ExcelDatabricksDeep Learning+2Technology$54 - $60/hr - WA
PhD Drug Discovery Scientist (Pharma / Biotech), AI ExpertRecently posted Auto Apply
Weekday AI · United States · Remote · Posted 19 Nov 2026 🇺🇸
ArticulateGenerative AIHealthcare$70 - $100/hr - HR
Lead Quant Researcher, Event Driven SignalsRecently posted Auto Apply
hermeneutic research · United States · Remote · Posted 19 Nov 2026 🇺🇸
SQLBootstrapDerivatives+4Salary not listed - ON

Applied Scientist, Foundation ModelsRecently posted Auto Apply
Oneapp · United States · Remote · Posted 19 Nov 2026 🇺🇸
Talent Acquisition$180k - $250k/yr - AP

Associate Scientist III, BioassaysRecently posted Auto Apply
Arrowhead Pharmaceuticals · Madison · Hybrid · Posted 19 Nov 2026 🇺🇸
$80k - $90k/yr - AP

Scientist I, Quality Control (Validation)Recently posted Auto Apply
Arrowhead Pharmaceuticals · Verona · Hybrid · Posted 19 Nov 2026 🇺🇸
$90k - $105k/yr - AP

Associate Scientist I, Mechanistic PharmacologyRecently posted Auto Apply
Arrowhead Pharmaceuticals · Madison · Hybrid · Posted 18 Nov 2026 🇺🇸
Healthcare$55k - $68k/yr - TT
Physics Expert, Quantum Optics and Atomic PhysicsRecently posted Auto Apply
True Talent Solutions Partners · United States · Remote · Posted 19 Nov 2026 🇺🇸
Auditing$100 - $170/hr - LA

Principal Scientist - Analytical Development & Quality ControlRecently posted Auto Apply
Landmarkbio · Watertown · On-site · Posted 18 Nov 2026 🇺🇸
ComplianceContinuous Improvement$150k - $180k/yr - MA

Senior / Principal BioProcess ScientistRecently posted Auto Apply
Maverickx · Austin · On-site · Posted 18 Nov 2026 🇺🇸
Root Cause AnalysisSalary not listed - MG
Junior Quant - MBSRecently posted Auto Apply
Man Group · Boston, New York · On-site · Posted 19 Nov 2026 🇺🇸
Onboarding$110k - $130k/yr - SA

Research Scientist - Frontier BenchmarksRecently posted Auto Apply
Snorkel AI · New York City · Remote · Posted 18 Nov 2026 🇺🇸
NLPArticulateLLM+1$200k - $350k/yr