Principal SW Engineer - LLM Serving (Cloud AI)

Principal SW Engineer - LLM Serving (Cloud AI) | San Diego, CA, United States | Hybrid | $200,800.00 - $301,200.00 This employer is a globally recognised leader in mobile and wireless technology, known for its innovation in AI and cloud solutions. They are looking for a seasoned engineer to join their dynamic Cloud AI team, focusing on cutting-edge inference acceleration software for large language models. This is a fantastic opportunity to contribute to the entire product lifecycle, from research and development to commercial deployment. The Role • Develop and deliver commercial software solutions for AI inference acceleration. • Design, implement, and optimize high-performance software for serving frameworks like vLLM. • Analyze and improve the performance of neural networks on complex multi-core architectures. • Collaborate with cross-functional teams throughout the product development lifecycle. • Lead and contribute to the planning and execution of large-scale software projects. What You'll Need • Bachelor's degree in Computer Science, Engineering, or a related field, with 8+ years of relevant engineering experience. • Proven experience delivering large commercial software projects with a focus on serving frameworks. • Strong development skills in PyTorch, C++, and Python. • Deep understanding of LLMs, multi-modal models, and reasoning models. • Expertise in analyzing and optimizing neural network performance on multicore systems and understanding of SoC architectures. • Excellent communication and teamwork skills. What's On Offer • Competitive salary range and a comprehensive benefits package. • Opportunity to work on groundbreaking AI technologies with a leading company. • Chance to influence product development from inception to deployment. • A fast-paced, collaborative, and innovative work environment. Apply via Haystack today!