Why this role stands out
This role offers a unique opportunity to shape the future of personalized AI by optimizing cutting-edge ML systems and contributing to a rapidly growing, well-funded startup. You'll thrive here if you're a skilled ML engineer passionate about performance, scalability, and bridging the gap between research and production. Apply now to join a dynamic team working with industry leaders like Microsoft and Notion.
Quick overview
Job description
About Engram
Today’s AI is a brilliant stranger: it can solve the world’s hardest math problems, but it knows next to nothing about you and your work. It rereads your files to answer even basic questions, burns an enormous amount of tokens when sifting through large corpuses, and between sessions, it retains scraps at best.
We train models to study your world and anticipate your questions in advance, forming engrams: compact memories that capture your knowledge and history. Our approach opens a new axis of scaling. The more we study your context at training time, the better we become at inference time.
We're already working with leaders in AI like Microsoft, Notion, and Harvey, and just raised $98M from General Catalyst, Kleiner Perkins, Sequoia, Factory, Modern, Amplify, Neo and others. Our investors and advisors include Assaf Rappaport, Andrej Karpathy, and Pieter Abbeel.
AI has spent years learning everything about the world. Now it should learn something about yours.
About this role
You’ll be among the first ML Systems Engineer, joining a team of machine learning researchers and performance engineers in building our personalization and continual learning API, which powers models and agents that learn from user context.
This role is focused on designing, optimizing, and scaling training and inference workloads —bridging the gap between cutting-edge AI research and production. This includes:
Designing and executing new frameworks, techniques, and systems to improve performance, reliability, latency, and efficiency.
Partner closely with researchers, turning prototypes into systems that run at scale and feeding systems constraints back into research decisions.
Optimize serving paths for personalization and memory retrieval, where per-user state and low latency both matter.
Work on distributed training — data and model parallelism, communication scheduling, and scaling efficiency across multiple GPUs and nodes.
You'll be the bridge between researchers and platform engineering, while working in deep collaboration with our customers (AI-native application-layer companies like Notion and Harvey). The architecture will be shaped by the constraints and requirements of our R&D work. There are no walls between product, research, and engineering here; delivering on our mission requires a multidisciplinary approach.
This is a founding hire in the truest sense. You’ll set the bar for engineering at Engram: code review, testing, on-call, and a security posture that gives customers confidence in entrusting us with their most sensitive data. You’ll also help build the engineering team around you and influence our engineering culture as we scale.
Your background looks like
Bachelor’s degree or equivalent experience in computer science, engineering, or similar.
5+ years of experience with training or inference systems, optimized workloads with measurable results.
Strong engineering foundation, with demonstrated excellence navigating complex technical environments and shipping high-quality code in a fast-paced environment.
Deep understanding of ML framework (eg. PyTorch, JAX), GPUs, distributed systems, and infrastructure.
Operate well in ambiguous environments — you will have real ownership and be responsible for steering the ship in a novel sector of the industry.
You have a bias toward action and a knack for turning research concepts into concrete, executable plans.
Bonus points if you have
Prior early-stage experience.
Experience in open-source ML or systems infrastructure projects.
Engram is based in San Francisco. This role is in-person in our SF office. We offer competitive cash compensation and startup equity.
Engram is an equal opportunity employer. We’re building a team that reflects a range of backgrounds and perspectives, and we welcome applicants regardless of race, color, religion, national origin, gender, gender identity, sexual orientation, age, disability, or veteran status.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- 1A

Senior/Staff AI/ML Engineer, Plant IntelligenceRecently posted Auto Apply
1 Arc Power · Mountain View · Hybrid · Posted 18 Nov 2026 🇺🇸
SQLLinearPython+2Technology$237k - $257.5k/yr - TT
Senior AI/ML EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 17 Nov 2026 🇺🇸
DockerGCPLLM+7Technology$180k - $275k/yr - RG
Machine Learning EngineerRecently posted Auto Apply
RZR Global Inc. · San Francisco · Hybrid · Posted 17 Nov 2026 🇺🇸
RustSQLFlink+10TechnologySalary not listed - SI

Principal AI/ML Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerGCP+23TechnologySalary not listed - SI

Principal AI/ML Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerGCP+23TechnologySalary not listed - SI

Principal AI/ML Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerGCP+23TechnologySalary not listed - SI

Head of AI/ML (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
RecruitingTalent AcquisitionWorkforce Planning+22TechnologySalary not listed - SI

Head of AI/ML (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
RecruitingTalent AcquisitionWorkforce Planning+22TechnologySalary not listed - SI

Head of AI/ML (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
RecruitingTalent AcquisitionWorkforce Planning+22TechnologySalary not listed - PH

ML Infra Engineer, ComputeRecently posted Auto Apply
Physicalintelligence · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
GCPCapacity PlanningPyTorch+4Salary not listed - TR
Automated Driving Advanced Development Intern, Machine Learning Research Auto Apply
Tri · Los Altos · Hybrid · Posted 9 Nov 2026 🇺🇸
RoboticsAutonomous DrivingPyTorch+3Technology$65/hr - TT
Member of Technical Staff, Applied MLRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 17 Nov 2026 🇺🇸
Continuous ImprovementLLMPython+1$175k - $350k/yr
