Haystack
← Back to Jobs
Remote
Technology

Senior AI Engineer

P2PSoftTek IncUnited States🇺🇸United StatesPosted 10 Aug 2026

Why This Role Stands Out

This remote Senior AI Engineer role offers a fantastic opportunity to build impactful AI solutions that directly enhance internal operations, providing significant growth and skill development across the entire AI stack. You'll thrive here if you're a practical, collaborative engineer eager to apply your expertise in a dynamic, forward-thinking tech environment, so consider applying to shape the future of applied AI!

Quick Overview

Work Type
Remote
Level
Mid Senior

Job Description

Senior AI Engineer (Applied AI)
Location: Remote

Role Summary

Join the Enterprise Applied AI team to build and ship production AI experiences and platforms that help internal teams work smarter and faster. As an AI Engineer, you will contribute across the stack, from data pipelines and retrieval to prompt/agent logic, evaluation/guardrails, and serving. You will collaborate closely with partners across Operations, Product, Sales, Customer Service, Finance, HR, and other internal teams to understand needs and deliver practical solutions that create tangible business value. You will develop responsibly, partnering with governance stakeholders on privacy, security, compliance, and safety.

 

Responsibilities

Build features and services across the AI stack: orchestration, retrieval/grounding, prompt/agent logic,

evaluation/guardrails, serving, and observability.

Implement robust data processing and integration pipelines to enable high-quality AI applications and analytics.

Contribute to design docs, code reviews, testing, and operational playbooks to ensure reliability, maintainability,

and resilience.

Partner with product and business stakeholders to define requirements, iterate quickly, and measure outcomes

using clear success metrics.

Instrument telemetry and evaluation to monitor quality, safety, latency, and cost; improve performance

based on data.

Follow responsible AI practices for security, privacy, compliance, and safety in collaboration with governance

teams.

Participate in on-call and incident response rotations as appropriate; drive post-incident improvements.

Share learnings via demos and documentation; contribute to AI literacy and enablement across the org.

Qualifications

BS/MS in Computer Science or a related field, or equivalent experience.

Practical software engineering experience building backend services, APIs, or data-intensive applications;

strong foundations in algorithms, data structures, and systems.

Exposure to or hands-on experience with LLM application concepts such as retrieval, grounding, prompt/agent

design, function/tool use, evaluation, safety/guardrails, and cost/latency optimization.

Proficiency with modern software delivery practices (version control, CI/CD, testing, observability); familiarity

with cloud-native services and containerization.

Ability to collaborate with product and business partners; strong written and verbal communication skills.

Bias to ship, learn, and iterate; comfortable working in fast-evolving technology areas with incomplete

information.

For Senior level: demonstrated ownership of services or platform components, end-to-end delivery of cross-service

initiatives, and contributions to reliability/SLOs and operational excellence.

 

 

This is the summary: Senior AI Engineer (Applied AI) — Technical Competencies.

 

1. Agentic Workflows & Memory Systems

 

Stateful Orchestration: Building and debugging production-grade, cyclic multi-agent workflows and state machines.

Context & Memory Engineering: Implementing multi-layered memory architectures including short-term memory for active turn execution, long-term memory for cross-session state persistence, and episodic summarization to manage token context windows.

Tool Call Management: Designing dependable function-calling patterns equipped with automated retry logic and self-correction handlers.

 

2. Data & Retrieval Infrastructure

Vector & Relational Storage: Managing relational metadata schemas and executing optimized semantic vector similarity searches inside a combined relational database layer.

Document Persistence: Utilizing document-store databases to store unstructured execution payloads, dynamic agent states, and raw chat logs.

Hybrid RAG Pipelines: Combining relational/exact-match queries with vector-space searches for high-precision retrieval.

 

3. Production Reliability & Performance  

Granular Tracing: Instrumenting end-to-end tracing to monitor agent execution steps, debug non-deterministic loops, and track token costs.

Automated Evals: Creating programmatic evaluation testing and scoring frameworks to benchmark agent accuracy before production deployment.  

Core Backend Development: Writing clean, concurrent, asynchronous Python code to handle high-throughput foundation model APIs.

Skills

LLM
Python

Similar jobs