Haystack
← Back to Jobs
Remote
Technology
MU

AI Platform Engineer | Canada (Remote- PST hours)

Momento USA LLCUnited States🇺🇸United StatesPosted Sep 28, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Remote
Location
United States
Posted
Yesterday
DatadogGrafanaHelmJWTJavaKubernetesLLMPrometheusPythonREST

Job Description

Momento USA is a global technology consulting, talent acquisition and creative development firm that addresses clients most pressing needs and challenges. 

We have an open AI Platform Engineer opportunity with our client based in Canada (Remote- PST hours) Please review the job description below and let me know if you are interested.

Role: AI Platform Engineer 
Location: Canada (Remote- PST hours)
Duration: Long Term

Role Overview
We are looking for an experienced AI Observability & Platform Engineer to build and operate the observability, reliability, governance, and platform capabilities supporting enterprise GenAI and agentic applications.

Key Responsibilities

  • Build and operate observability for LLM gateways, model routing, MCP servers, agent runtimes, and AI platform services.
  • Implement end-to-end telemetry using OpenTelemetry, Langfuse, metrics, logs, and distributed tracing.
  • Monitor and analyze LLM/agent latency, errors, token usage, model performance, quality, evaluation results, and production behavior.
  • Develop dashboards, alerts, and reporting for AI reliability, performance, quality, and operational health.
  • Build AI cost and usage observability, including attribution by application, team, user, model, workflow, and environment across providers such as OpenAI, Anthropic, and Gemini.
  • Establish observability and evaluation standards for LLM and agentic applications, including traces, prompts, responses, tool calls, evaluations, and regression signals.
  • Support AI evaluation and monitoring through golden datasets, scoring, prompt/model comparisons, and production quality checks.
  • Operate AI platform services on Kubernetes using Helm, Kustomize, GitOps, autoscaling, and progressive/zero-downtime deployments.
  • Implement platform security, access control, secrets management, PII protection, guardrails, and audit logging.
  • Enable observability across MCP, LangChain, LangGraph, CrewAI, Google ADK, and other agent frameworks.
  • Build self-service capabilities, templates, and automation that allow development teams to onboard AI applications and agents efficiently.
  • Partner with engineering teams to turn observability insights into platform improvements, reliability enhancements, and cost optimization.

Key Skills

  • AI/LLM Observability: Langfuse, OpenTelemetry, LLM tracing, AI evaluation
  • AI Platforms: LLM gateways, model routing, MCP, agentic AI
  • Cloud/Platform: Kubernetes, Helm, Kustomize, GitOps, APIs
  • Monitoring: Prometheus, Grafana, Datadog or similar platforms
  • AI/ML: OpenAI, Anthropic, Gemini, LangChain, LangGraph, CrewAI, Google ADK
  • Engineering: Python/Java/Go, REST APIs, CI/CD
  • Security: OAuth2/OIDC, JWT, RBAC, secrets management, PII/AI guardrails

Yousuf M

Technical Recruiter.

Momento USA | Exceeding Customer Expectations…

440 Benigno Blvd, Unit #A 2nd Floor. Bellmawr, NJ 08031

Interstate Business Park

Direct:  Fax:

Email: LinkedIn: Web:

 

Minority Certified by SWAM
National Minority Certified by NMSDC

One of the fastest growing company in NJ
Awarded fastest growing Asian American business by Diversitybusiness.com
E-verified Company

Information transmitted by this e-mail is proprietary to Momento USA and/ or its Customers and is intended for use only by the individual or entity to which it is addressed, and may contain information that is privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please notify us immediately at and delete this mail from your records.

Note: Momento USA is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

Similar jobs