Why this role stands out
This Product Engineer role at Litellm offers a unique opportunity to shape AI infrastructure alongside founders, directly impacting thousands of developers worldwide. If you thrive on owning projects from ideation to production, enjoy customer interaction, and are eager to build impactful features in a fast-paced environment, this is an exciting chance to grow your career. You'll gain invaluable experience in a rapidly evolving industry with a company trusted by leading organizations.
Quick overview
Job description
Product Engineer
LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.
We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.
About the Role
This isn't a traditional product management role, and it isn't a traditional software engineering role.
You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.
If you enjoy owning a problem end-to-end—from idea to production—you'll thrive here.
Responsibilities
Build new product features from concept to production.
Work directly with customers to understand pain points and validate solutions.
Ship quickly while maintaining a high quality bar.
Prototype new ideas and iterate based on user feedback.
Own major product areas and continuously improve them over time.
Design backend APIs and services using Python and FastAPI.
Build intuitive developer experiences across our API, dashboard, and CLI.
Collaborate directly with the founders on product direction and technical decisions.
Help define and build LiteLLM's second major product.
What We're Looking For
Bachelor's or Master's degree in Computer Science or a related field.
Strong software engineering fundamentals.
Experience building production software, preferably with Python.
Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
Strong product intuition and curiosity about how customers use software.
Excellent written and verbal communication.
High ownership—you naturally identify problems and solve them without waiting to be asked.
Comfortable operating in ambiguity and making decisions with incomplete information.
Excited by shipping quickly and learning from real users.
Bonus Points
Experience at an early-stage startup.
Experience building developer tools or infrastructure products.
Open source contributions.
You've built and launched your own product.
Familiarity with AI infrastructure, LLMs, or developer platforms.
Why Join LiteLLM?
Work directly with the founders every day.
Build products used by thousands of engineering teams around the world.
Own meaningful product decisions—not just implementation.
Move incredibly fast and see your work in production immediately.
Help define the future of AI infrastructure and developer tooling.
Competitive salary, equity, health, dental, and vision benefits.
About LiteLLM
LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.
If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- DO
Mechanical Engineer: RF Subsystems Auto Apply
Dodmg · Calabasas · On-site · Posted 10 Nov 2026 🇺🇸
RecruitingANSYSAssembly+5Engineering$81.1k - $98.9k/yr - CF
Intern - Molten Salt Blanket Engineer - Summer 2027Recently posted Auto Apply
Cfsenergy · Devens · On-site · Posted 20 Nov 2026 🇺🇸
ComplianceData AnalysisEngineering$25 - $38/hr - KI

Mechanical/HVAC SuperintendentRecently posted Auto Apply
Kelso Industries · Lorton · Hybrid · Posted 20 Nov 2026 🇺🇸
Stakeholder ManagementBIMHVACConstruction$105k - $150k/yr - HA

Senior Mechanical EngineerRecently posted Auto Apply
Halobraid · Cambridge · On-site · Posted 20 Nov 2026 🇺🇸
RoboticsCADCFD+1EngineeringSalary not listed - RL

Mechanical Engineer IIRecently posted Auto Apply
Rocket Lab Corporation · Long Beach · Hybrid · Posted 19 Nov 2026 🇺🇸
CADFEAEngineering$82.4k - $123.6k/yr - PI

Internship, GNC Engineering (Summer 2027)Recently posted Auto Apply
Pivotal · Palo Alto · On-site · Posted 19 Nov 2026 🇺🇸
MATLABGitRobotics+2Engineering$30 - $35/hr - PI

Internship, Autonomy - Path Planning (Summer 2027)Recently posted Auto Apply
Pivotal · Palo Alto · On-site · Posted 19 Nov 2026 🇺🇸
MATLABRoboticsC+++2$30 - $35/hr - MA

Senior Design Engineer - MechanicalRecently posted Auto Apply
Mantisinnovation · Morristown · Remote · Posted 19 Nov 2026 🇺🇸
ComplianceConstruction ManagementEstimating+9Engineering$130k - $160k/yr - MA

Senior Design Engineer - MechanicalRecently posted Auto Apply
Mantisinnovation · Concord · Remote · Posted 19 Nov 2026 🇺🇸
ComplianceConstruction ManagementEstimating+9Engineering$130k - $160k/yr - WA
Mechanical Design Engineer (SolidWorks, CATIA, NX), AI ExpertRecently posted Auto Apply
Weekday AI · United States · Remote · Posted 19 Nov 2026 🇺🇸
AssemblyCADCATIA+5$60 - $100/hr - SI

Senior Engineer, Equipment IntegrationRecently posted Auto Apply
Sila · Alameda · Hybrid · Posted 18 Nov 2026 🇺🇸
AssemblyAutoCADCAD+2Engineering$128k - $162k/yr - SP

Sr. Operations Engineer, Security HardwareRecently posted Auto Apply
SpaceX · Bastrop · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLProcess ImprovementSQL Server+2TechnologySalary not listed
