Senior Software Engineer – Inference with Security Clearance

We’re seeking a senior software engineer to support our AI infrastructure team, helping build and maintain the foundation for advanced AI capabilities while supporting an ecosystem of AI-enabled applications.

Responsibilities

• Lead the evaluation, configuration, and deployment of inference models for users.
• Mentor engineers and grow development best practices and standards for the team.
• Develop in-house services to guarantee high-quality inference service.
• Collaborate with other teams to establish solid infrastructure and integrate LLM-powered tools.
• Support surge efforts to meet short-term, high-priority inference needs from stakeholders.

Required Skills

• Experience with Python and/or modern programming languages.
• Experience with Argo CD and/or other CI/CD frameworks.
• Knowledge of Kubernetes/Helm.
• Experience with AWS or another cloud service provider.
• Strong communication skills and ability to mentor engineers.
• Excellent leadership and stakeholder management skills. Nice to Have:
• Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
• Familiarity with other LLM hosting frameworks and practices.
• Experience supporting production software using SRE best practices.
• Knowledge of observability frameworks like Elastic, Grafana/Prometheus.
• Experience with Docker and containerization.

Experience Required: 12 years with Bachelor’s degree in a technical discipline or 16 years without degree Location: Columbia, MD Clearance: TS/SCI with Polygraph required Salary Range: $204,000 - $247,000