Why this role stands out
This role offers a unique opportunity to build and scale critical ML inference systems for a mission-driven company revolutionizing job discovery, perfect for engineers passionate about optimizing performance and driving real user impact. You'll gain extensive experience in production ML and contribute directly to a product that helps millions find meaningful employment. Apply now to shape the future of job search technology!
Quick overview
Job description
Job discovery is broken. Indeed and LinkedIn want to keep it that way. Join our team and help millions of people put food on the table by finding the perfect job.
HiringCafe.com is building a 100× better job search engine — fast, comprehensive, honest, and actually useful. We index millions of jobs, remove noise, rank what matters, and help people find real opportunities without dark patterns, ads, or pay-to-win placement.
We are looking for a founding ML engineer who can help us turn powerful AI and ML models into fast, reliable production systems. You will own the bridge between model development and real user-facing infrastructure: deploying models, optimizing inference latency and throughput, scaling serving systems, and making sure our models run efficiently in production.
This is a hands-on engineering role for someone who loves the details of model performance, GPU utilization, inference architecture, and production reliability.
What You’ll Do
Deploy and integrate researcher-trained model checkpoints into our cloud infrastructure and production pipelines.
Profile and benchmark model performance to identify latency, throughput, memory, and compute bottlenecks.
Implement optimization techniques such as quantization, pruning, batching, caching, efficient attention, and precision trade-offs while preserving model quality.
Build scalable multi-GPU inference systems for search, ranking, recommendations, agents, and other AI-powered product experiences.
Design reliable model-serving architecture that can support millions of users.
Develop efficient training and fine-tuning workflows where needed, including distributed training, mixed precision, and parallelism strategies.
Work closely with our search & engineering teams to make model deployment a smooth part of our development workflow.
You May Be a Strong Fit If You
Have deployed and optimized deep learning models in production environments.
Have experience with large-scale model serving, multi-GPU inference, or high-throughput inference systems.
Understand inference optimization techniques such as quantization, pruning, compilation, batching, caching, and memory optimization.
Have strong instincts for profiling, benchmarking, and debugging model performance.
Are familiar with efficient attention mechanisms, transformer optimization, or modern LLM/embedding/ranking model infrastructure.
Have worked with inference frameworks or serving stacks such as SGLang, vLLM, TensorRT, or equivelant.
Can write clean, production-quality code and integrate ML systems into backend infrastructure.
Are comfortable with cloud platforms, distributed systems, storage systems, and modern ML training or serving workflows.
Want ownership, leverage, and responsibility from day one.
Logistics
This role is based in Cupertino, where we work in person. We believe the best ideas come from being in the same room.
We offer generous health, dental, and vision coverage, paid parental leave, and relocation support.
Don’t meet every single qualification? That’s okay. We care more about your trajectory than checking every box. If the role excites you and the mission resonates, we’d love to hear from you.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- TT
Senior AI/ML EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 17 Nov 2026 🇺🇸
DockerGCPLLM+7Technology$180k - $275k/yr - RG
Machine Learning EngineerRecently posted Auto Apply
RZR Global Inc. · San Francisco · Hybrid · Posted 17 Nov 2026 🇺🇸
RustSQLFlink+10TechnologySalary not listed - SI

Principal AI/ML Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerGCP+23TechnologySalary not listed - SI

Principal AI/ML Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerGCP+23TechnologySalary not listed - SI

Principal AI/ML Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerGCP+23TechnologySalary not listed - SI

Head of AI/ML (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
RecruitingTalent AcquisitionWorkforce Planning+22TechnologySalary not listed - SI

Head of AI/ML (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
RecruitingTalent AcquisitionWorkforce Planning+22TechnologySalary not listed - SI

Head of AI/ML (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
RecruitingTalent AcquisitionWorkforce Planning+22TechnologySalary not listed - PH

ML Infra Engineer, ComputeRecently posted Auto Apply
Physicalintelligence · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
GCPCapacity PlanningPyTorch+4Salary not listed - TR
Automated Driving Advanced Development Intern, Machine Learning Research Auto Apply
Tri · Los Altos · Hybrid · Posted 9 Nov 2026 🇺🇸
RoboticsAutonomous DrivingPyTorch+3Technology$65/hr - TT
Member of Technical Staff, Applied MLRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 17 Nov 2026 🇺🇸
Continuous ImprovementLLMPython+1$175k - $350k/yr - TT
Member of Technical Staff, ML SystemsRecently posted Auto Apply
True Talent Solutions Partners · Menlo Park · On-site · Posted 17 Nov 2026 🇺🇸
CUDADeep LearningLLM+2$180k - $260k/yr