Haystack
← Back to Jobs
Employee
Technology

Senior Software Engineer – Inference with Security Clearance

Neural SolutionsColumbia, MD🇺🇸United StatesPosted 31 Jul 2026

Quick Overview

Salary
$204k - $247k/yr
Work Type
Hybrid
Schedule
Employee
Level
Mid Senior

Job Description


Join us in building the next generation of AI infrastructure that will power innovation across our organization. We’re seeking a senior software engineer to support our AI infrastructure team. In this role, you’ll help build and maintain the foundation for AI capabilities while supporting a broader ecosystem of AI-enabled applications. Responsibilities: * Lead the evaluation, configuration, and deployment of inference models for our users. * Mentor engineers and grow development best practices and standards for the team. * Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs. * Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer. Required Skills: * Experience with Python and/or other modern programming languages. * Experience with Argo CD and/or other CI/CD frameworks. * Experience with Kubernetes/Helm. * Experience with AWS or other cloud service providers. * Strong communication skills and ability to mentor other engineers. * Excellent leadership and stakeholder management skills. Nice to Have: * Experience with vLLM, LiteLLM, or similar inference-serving frameworks. * Experience supporting production software using Site Reliability Engineering (SRE) best practices. * Knowledge of and interest in hosting AI capabilities. Experience Required: 12 years with Bachelor’s degree in a technical discipline, or 16 years without degree Location: Columbia, MD Clearance: TS/SCI with Polygraph required Salary Range: $204,000 - $247,000

Skills

AWS
Helm
Kubernetes
LLM
Python
Stakeholder Management

Similar jobs