AI Architect

Job Title: AI Architect

Location: Schaumburg, IL (Hybrid – 1 Day Onsite per Week)
Duration: 3–4 Weeks

Job Description:

We are looking for an experienced AI Architect to support a short-term project focused on AI Observability. The ideal candidate should have experience designing and implementing observability solutions for AI/ML and Generative AI applications.

Key Responsibilities:

• Define and implement AI observability strategies to monitor AI/ML and GenAI applications.

• Monitor model performance, accuracy, latency, reliability, and response quality.

• Implement tracing, logging, and monitoring for LLM-based applications and AI workflows.

• Identify issues such as hallucinations, model drift, and performance bottlenecks.

• Recommend tools and best practices for AI monitoring, evaluation, and troubleshooting.

Required Skills:

• Strong experience in AI/ML architecture and AI observability.

• Knowledge of LLM monitoring, tracing, and evaluation.

• Experience with tools such as LangSmith, Arize Phoenix, Langfuse, MLflow, or similar.

• Understanding of RAG pipelines, LLM performance monitoring, and model evaluation.