Quick overview
Job description
About
We are reimagining the phone. AI phones need to be proactive, intuitive, intelligent and low cost. This is a mission critical for rest of the world to adopt intelligence.
There are over 5 billion people using everyday applications such as email, messaging, notes, tasks, and calendars, yet most are not AI-native. Our mission is to build proactive applications and devices that bring intelligence into daily conversations, coordination and workflows, with minimal prompting.
Responsibilities
Evaluate suitable open-weight and commercially available models for on-device execution.
Benchmark model performance on target mobile hardware.
Integrate models into Android applications and system services.
Optimize inference latency, memory consumption and power usage.
Evaluate quantization, compression and model distillation techniques.
Work with CPU, GPU and NPU acceleration.
Evaluate local model capabilities for different workflows.
Build hybrid local/cloud model routing mechanisms.
Identify which tasks can be handled locally and which require cloud inference.
Work with AI agent engineers to integrate local models into the agent runtime.
Requirements
Strong ML systems or inference engineering experience.
Experience deploying and optimizing models.
Strong Python and C++ skills.
Understanding of neural network inference.
Experience with model quantization and performance optimization.
Understanding of hardware constraints and inference benchmarks.
Nice to have
Experience with on-device LLMs.
Qualcomm QNN, MediaTek NeuroPilot or similar acceleration frameworks.
ONNX Runtime, LiteRT, TensorFlow Lite or ExecuTorch.
Android NDK.
Mobile or edge AI deployment.
Multimodal model optimization.
Similar jobs
- OK

Staff Engineer, Machine Learning & Data InfrastructureRecently posted Auto Apply
OKX · San Jose · Hybrid 🇺🇸
SQLScalaApache Spark+9Technology$214.7k - $322.0k/yr - EV

Senior Machine Learning (ML) Engineer (CCC Casualty / Claims Intelligence)Recently posted Auto Apply
EvolutionIQ · Chicago · Remote 🇺🇸
SQLLLMPython+3Technology$180k - $225k/yr - AI

Senior Machine Learning Engineer, RelevanceRecently posted Auto Apply
Airbnb · United States · Hybrid 🇺🇸
ScalaA/B TestingAirflow+11Technology$200k - $235k/yr - RO

Principal Machine Learning Engineer - MatchmakingRecently posted Auto Apply
Roblox · San Mateo · Hybrid 🇺🇸
LeverMachine LearningTechnology$295.3k/yr - BJ
AI Phone - Applied ML / Model EngineerRecently posted Auto Apply
Bjakcareer · United States · Remote 🇺🇸
NLPDeep LearningLLM+2Salary not listed - TT
Member of Technical Staff, ML SystemsRecently posted Auto Apply
True Talent Solutions Partners · Menlo Park · On-site 🇺🇸
CUDADeep LearningMachine Learning$180k - $260k/yr - TT
Founding ML Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site 🇺🇸
DockerComputer VisionHugging Face+3$180k - $230k/yr - TT
Founding Reinforcement Learning EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site 🇺🇸
AWSLLMPyTorch+3Engineering$125k - $200k/yr - AY
Machine Learning Architect Auto Apply
Ayosemi · Boston · On-site 🇺🇸
PyTorchPythonTensorFlow+1TechnologySalary not listed - BA

Staff Machine Learning EngineerRecently posted Auto Apply
Babylist · United States · Hybrid 🇺🇸
MySQLSwiftGit+24Technology$233.5k - $290.7k/yr - AD

Senior Machine Learning Engineer, Financial ProductsRecently posted Auto Apply
Adyen · San Francisco · Hybrid 🇺🇸
DockerSQLMLOps+12Technology$227.5k - $317k/yr - TT
Senior Data & Machine Learning EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site 🇺🇸
SQLETLdbtTechnology$200k - $300k/yr