Quick overview
Job description
-
Optimize transformer-based LLMs for low-latency and high-throughput inference.
-
Optimize kernels and model graphs using tools like CUDA, Triton, and custom fused operators.
-
Implement and benchmark (Quantization, Knowledge distillation, structured and unstructured pruning, KV-cache optimization, etc.).
-
Deploy optimized models across GPUs, CPUs, and edge acceleators.
-
Contribute to internal tooling and documentation for model optimization flows.
-
Master in CS/CE/EE, or equivalent, with 3 + years of industry experience.
-
Good knowledge of PyTorch.
-
Knowledge of transformer architecture and ways to accelerate the training and inference of transformer models.
-
Previous experience in the autonomous driving industry.
-
Knowledge of Torchscript and Nvidia TensorRT.
-
Strong programming skills in Python and C++
-
Familiarity with GPU CPU, NPU, DSP architecture.
-
Deep understanding of memory bandwidth, compute bottlenecks, and hardware-aware model optimization
-
Being efficiently in solving complex problems collaboratively on larger teams
- A fun, supportive and engaging environment.
- Infrastructures and computational resources to support your work.
- Opportunity to work on cutting edge technologies with the top talents in the field.
- Opportunity to make significant impact on the transportation revolution by the means of advancing autonomous driving.
- Competitive compensation package.
- Snacks, lunches, dinners, and fun activities.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- UP

Senior Backend Software Engineer, Personal LoansRecently posted Auto Apply
Upstart · United States · Remote · Posted 21 Nov 2026 🇺🇸
RubyCADJava+9Technology$166.9k - $230.9k/yr - TW

Principal Engineer, Cloud SecurityRecently posted Auto Apply
Twilio · United States · Remote · Posted 20 Nov 2026 🇺🇸
DockerGCPAWS+8Technology$192.6k - $283.2k/yr - TA

Manager, Solutions ArchitectRecently posted Auto Apply
Together AI · San Francisco · Hybrid · Posted 21 Nov 2026 🇺🇸
Customer SuccessForecastingLLM+2Technology$300k - $325k/yr - TA

Solutions ArchitectRecently posted Auto Apply
Together AI · New York · Hybrid · Posted 21 Nov 2026 🇺🇸
DockerAnsibleCustomer Success+6Technology$250k - $300k/yr - SP

Electrical Design Engineer (Starfall Avionics)Recently posted Auto Apply
SpaceX · Hawthorne · Hybrid · Posted 21 Nov 2026 🇺🇸
AssemblyAltiumElectrical Design+1Technology$105k - $140k/yr - SP

Sr. Electrical Systems Engineer (Falcon & Dragon)Recently posted Auto Apply
SpaceX · Hawthorne · Hybrid · Posted 21 Nov 2026 🇺🇸
MATLABCADC+++1Technology$140k - $230k/yr - SP

Sr. Avionics Systems Engineer (Falcon & Dragon)Recently posted Auto Apply
SpaceX · Hawthorne · Hybrid · Posted 21 Nov 2026 🇺🇸
MATLABCADC+++1Technology$140k - $230k/yr - SP

Electrical Systems Engineer (Special Programs)Recently posted Auto Apply
SpaceX · Hawthorne · Hybrid · Posted 21 Nov 2026 🇺🇸
MATLABC++PythonTechnology$105k - $140k/yr - SP

Electrical Systems Engineer (Falcon & Dragon)Recently posted Auto Apply
SpaceX · Hawthorne · Hybrid · Posted 21 Nov 2026 🇺🇸
MATLABCADC+++1Technology$105k - $122.5k/yr - SP

Sr. Design Reliability Engineer (Falcon & Dragon)Recently posted Auto Apply
SpaceX · Hawthorne · Hybrid · Posted 21 Nov 2026 🇺🇸
MATLABMicrosoft ExcelANSYS+6Technology$135k - $215k/yr - CE

Staff Data EngineerRecently posted Auto Apply
Consumer Edge · United States · Hybrid · Posted 21 Nov 2026 🇺🇸
SQLSnowflakeAirflow+6Technology$175k - $210k/yr - HA

Creative AI EngineerRecently posted Auto Apply
Harvey · San Francisco · Hybrid · Posted 21 Nov 2026 🇺🇸
FigmaLLMTechnology$168.4k - $252.6k/yr
