Why This Role Stands Out
This hybrid role offers an exceptional opportunity to shape the future of AI infrastructure, working with cutting-edge LLMs and enjoying competitive compensation between $124,000 and $181,000 annually. If you are a skilled Software Engineer eager to continuously develop your expertise in a dynamic, impactful environment with a leading defense technology company, this position is perfect for you. Apply today to contribute to critical AI advancements!
Quick Overview
Job Description
Job Description SALARY RANGE $124,000 - $181,000/year. DUTIES As a successful candidate for the Software Engineer I - Inference role, you will join our AI infrastructure team to build and maintain the foundation for customer AI capabilities while supporting a broader ecosystem of AI-enabled applications. Your primary focus will be ensuring seamless access to the highest quality large language models (LLMs) throughout the inference software stack. Operating in a dynamic environment where requirements shift as mission needs evolve and new technologies emerge, you will continuously sharpen your skills and turn loosely defined problems into impactful, working solutions.
Required Skills SKILLS
- Procure, configure, and test new inference models to prepare them for seamless release to the user base
- Develop in-house services and techniques to guarantee continuous, high-quality inference performance
- Partner with model vendor teams to establish reliable integration pipelines for closed-source models
- Collaborate with teammates on surge efforts to address high-priority, short-term customer inference demands
- Engage with cross-functional teams to build resilient service infrastructure and integrate LLM-powered tools for end-user needs QUALIFICATIONS Three (3) years' experience as a SWE in programs and contracts of similar scope, type, and complexity is required.
A Bachelor's degree in Computer Science or a related discipline from an accredited college or university is required. Four (4) years of additional SWE experience on projects with similar software processes may be substituted for a bachelor's degree.
Additional Requirements
- Develop with Python and other modern programming languages
- Utilize Argo CD or other modern CI/CD frameworks
- Deploy and manage containerized applications using Kubernetes and Helm
- Operate within AWS or other major cloud service provider environments
- Demonstrate a proven ability to rapidly learn and adopt emerging technologies
- Communicate clearly and collaborate proactively to address technical and mission needs
Desired Skills NICE-TO-HAVES
- Leverage vLLM, LiteLLM, or similar inference-serving frameworks
- Apply modern LLM hosting frameworks and deployment practices
- Support production software using Site Reliability Engineering (SRE) best practices
- Utilize Elastic, Grafana, Prometheus, or other observability frameworks
- Package and manage applications using Docker and containerization
- Implement traffic shaping and quality-of-service engineering strategies
- Demonstrate strong interest and foundational knowledge in hosting AI capabilities
Similar jobs
- AI
Software Engineer, Agent Platform
NewAuto ApplyAnduril Industries
Washington🇺🇸$220k - $292k/yrHybrid9 hours agoDockerLinearRobotics+6Technology - RI
Software Engineer, Edge AI
NewAuto ApplyRivianvw.tech
Palo Alto🇺🇸Hybrid8 hours agoRustRoboticsC+++3Technology - AI
Senior Software Engineer, Tech Foundations
NewAuto ApplyAirbnb
San Francisco🇺🇸$196k - $227k/yrHybrid8 hours agoGCPMicroservicesAWS+7Technology - UA
Forward Deployed Engineer (U.S. Government / IL5)
NewAuto ApplyUare.ai
San Francisco or Los Altos🇺🇸Hybrid9 hours agoHIPAAPythonAzure+2Engineering - PA
Principal Product Engineer, US
NewAuto ApplyPartly.com
Austin🇺🇸On-site10 hours agoOnboardingRustTikTok - UD
Senior Software Engineer
NewAuto ApplyUniversal DX
United States🇺🇸Hybrid10 hours agoDockerNestJSSQL+13Technology - OP
Software Engineer, Money Platform
NewAuto ApplyOpenrouter
Remote (US)🇺🇸Remote5 hours agoOnboardingSQLKafka+3Technology - OP
Software Engineer, Identity Platform
NewAuto ApplyOpenrouter
Remote (US)🇺🇸Remote5 hours agoOnboardingSQLGoogle Workspace+9Technology - BN
Vice President, AI / Machine Learning Software Engineer
NewBNY
New York🇺🇸Hybrid13 hours agoDockerFastAPIOracle+22Technology - LI
Principal Staff Software Engineer, Data Infrastructure
NewAuto ApplyLinkedIn
Mountain View, CA🇺🇸Hybrid10 hours agoPostgreSQLMySQLFlinkTechnology - LI
Software Engineer Intern, Undergraduate - Summer 2027 (Mountain View, CA)
NewAuto ApplyLinkedIn
Mountain View, CA🇺🇸Hybrid12 hours agoAgileTechnology - IN
Platform Software Developer
NewAuto ApplyIntelerad
Remote🇺🇸$109k - $145k/yrHybrid5 hours agoDockerShellSpring+15Technology