Why this role stands out
This role offers a unique opportunity to shape the future of personal AI by optimizing inference stacks for cutting-edge hardware, perfect for experienced systems engineers passionate about performance and efficiency. You'll gain invaluable experience in a rapidly evolving field, contributing directly to a company building a more intelligent and controlled future for its users. Apply now to be at the forefront of AI innovation!
Quick overview
Job description
About Ghost
Ghost is a personal AI hardware company.
To realize the full benefit of what models will do for people, we believe an entirely new platform will be built around AI. Some devices will let your AI understand what is happening around you, others will enable you to get things done without navigating apps or menus.
As these systems become more capable and more personal, it matters who owns them. We’re building a future where that intelligence belongs to you, with an ecosystem of devices and software that gives you greater control over your time, attention, and the things you want to accomplish.
What you'll do
Build and optimize the inference stack that runs personal AI models locally on Core.
Improve latency, throughput, and memory efficiency across interactive requests and background agent workloads.
Profile performance across the hardware and software stack, optimizing kernels, memory movement, and runtime execution.
Build benchmarks that reflect real product workloads, including long contexts, concurrent agents, and sustained operation.
Work closely with the hardware, post-training, and product teams.
Who you are
Experience building or optimizing inference systems for language models.
Strong systems programming skills in C++ or similar languages, alongside proficiency in Python.
Familiarity with GPU architecture, memory management, and performance profiling.
Experience with inference runtimes, quantization, or GPU kernel development using CUDA, Triton, or equivalent tools.
Strong experimental judgment: you can identify bottlenecks and evaluate tradeoffs between speed, memory, power, and model quality.
Ability to work on-site in San Francisco.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- BP

Software Engineer, Systems IntegrationRecently posted Auto Apply
Base Power · Austin · On-site · Posted 16 Nov 2026 🇺🇸
GoPythongRPC+1TechnologySalary not listed - AX

Embedded Software Engineer IRecently posted Auto Apply
Axon · Seattle · Hybrid · Posted 16 Nov 2026 🇺🇸
TCP/IPDNSC+++3Technology$106.5k - $170.4k/yr - AI

Software Engineer, DevAIRecently posted Auto Apply
Airbnb · United States · Hybrid · Posted 16 Nov 2026 🇺🇸
KotlinPythonTypeScriptTechnology$162k - $190k/yr - AT

Senior Automotive Embedded Software Developer – Embedded C / ECURecently posted Auto Apply
ALTEN Technology USA · Detroit · Hybrid · Posted 16 Nov 2026 🇺🇸
Embedded SystemsRoboticsCTechnologySalary not listed - GR

Senior Software Engineer, Applied AIRecently posted Auto Apply
Gravie · Remote · Remote · Posted 16 Nov 2026 🇺🇸
PythonReactTypeScriptTechnologySalary not listed - UI

Senior Software Engineer -AIRecently posted Auto Apply
Uipath · Bellevue · On-site · Posted 16 Nov 2026 🇺🇸
MicroservicesC#Java+5TechnologySalary not listed - TH
Software Engineer, Data InfrastructureRecently posted Auto Apply
Thinkingmachines · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
RustApache SparkAirflow+7Technology$300k - $400k/yr - RE

Software Engineer, EnterpriseRecently posted Auto Apply
Replit · Foster City · Hybrid · Posted 16 Nov 2026 🇺🇸
SAMLSSOCSS+5TechnologySalary not listed - TT
Product EngineerRecently posted Auto Apply
True Talent Solutions Partners · Palo Alto · On-site · Posted 16 Nov 2026 🇺🇸
SQLAmplitudeMixpanel+3$185k - $205k/yr - TT
Member of Technical StaffRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
AWSCUDA$200k - $300k/yr - TT
Lead Product EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 16 Nov 2026 🇺🇸
SourcingNext.jsFigma+1$225k - $275k/yr - TT
Software EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 15 Nov 2026 🇺🇸
AWSPythonReact Native+2Technology$193k - $258k/yr
