Quick Overview
Seniority
Mid Senior
Location
San Francisco Bay Area, United States
Posted
4 months ago
C++Python
Job Description
We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.
Responsibilities:
- Compress and optimize large language and vision models for on-device inference.
- Develop pipelines for model distillation and hardware-specific compilation.
- Benchmark performance across various NPU/GPU architectures.
Qualifications:
- Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
- Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
- Strong C++ and Python skills.
Similar jobs
- EX
.NET 6+ / .NET 8 with Blazor - 14 years exp required - Alpharetta GA : Contract
NewExatech Inc
Alpharetta, GA🇺🇸HybridYesterdayMongoDBSOAPC#+6 - UT
Master Control Operator # 26-21484
NewU.S. Tech Solutions Inc.
Littleton, CO🇺🇸HybridYesterday - AT
Senior PeopleSoft HCM Techno-Functional Analyst(Benefits Administration)
NewAmzur Technologies, Inc.
Jersey City, NJ🇺🇸HybridYesterdaySQLBenefits AdministrationCOBOL+4 - MC
OneShield Technical Lead || Bala Cynwyd, PA
NewMcKinsol Consulting Inc
Bala Cynwyd, PA🇺🇸HybridYesterdayMicroservicesOracleSOAP+13 - WS
Data Migration Technical Lead – AWS
NewWise Skulls Corp.
St. Louis, MO🇺🇸On-siteYesterdaySQLAWSETL+9 - NI
New Accounts Representative at Major Japanese Bank
NewNSD International, Inc.
Brea, CA🇺🇸On-siteYesterdayCompliance