Senior AI/ML Ops Engineer Agent Evaluation, Observability & Production Reliability, Onsite - 69753

Senior AI/ML Ops Engineer Agent Evaluation, Observability & Production Reliability, Onsite

We have an immediate need for an experienced Senior AI/ML Ops Engineer with strong expertise in LLM evaluation, MLOps, agent observability, production reliability, and AI platform engineering to build and operate the evaluation and reliability backbone for production AI agents.

This is an onsite position based in Austin, TX or Sunnyvale, CA for a candidate with deep experience in Python, LLMs, LLM-powered applications, AI Agent Evaluation, Golden Datasets, LLM-as-Judge, Regression Testing, CI/CD, GitHub Actions, GitLab CI, Jenkins, OpenTelemetry, Datadog, Grafana, Prometheus, LangSmith, Langfuse, Arize Phoenix, Braintrust, and W&B Weave. Experience with Agentic AI, Multi-Agent Systems, Tool Use, RAG Pipelines, Prompt Management, Model Routing, Fine-Tuning Workflows, A/B Testing, Causal Inference, Knowledge Graphs, and AI Observability will be highly valued.

For immediate consideration, please contact:
Pankaj
PRIMUS Global Services
Phone: Desk Ext. 214
Email: