Why this role stands out
This remote AI Prompt Engineer role offers an exciting opportunity to shape the future of agentic AI solutions, leveraging cutting-edge LLM technology and autonomous reasoning. If you thrive on hands-on engineering, solutioning, and collaborating to deliver impactful enterprise AI platforms, this position is an excellent next step in your career. Apply now to join a dynamic team and contribute to innovative AI development.
Quick overview
Job description
AI Prompt Engineer / Agentic AI Engineer (3 ON, 3 Off)
Role Summary
- Role Type: Client-facing, hands-on engineering + solutioning (pre-sales through early delivery)
- Location: Major US hub (e.g., New York, Bay Area, Dallas, Chicago – flexible for the right candidate). Travel Expected.
- Level: Manager/Principal/Senior Principal
- Business Unit: (Enterprise AI Platforms & Agentic Solutions).
- Reporting to: Artificial Intelligence Leader, North America.
About Company:
Role summary
The resource will support the design, development, and delivery of Agentic AI solutions by creating, optimizing, and managing AI prompts, agent workflows, and MCP-integrated tools. The role will focus on enabling intelligent AI agents capable of autonomous reasoning, task orchestration, tool utilization, and workflow execution across enterprise applications.
Key Responsibilities
- Design, develop, and optimize prompts for Large Language Models (LLMs) to improve accuracy, reliability, and business outcomes.
- Build and configure Agentic AI solutions that leverage planning, reasoning, memory, and multi-step task execution capabilities.
- Develop and integrate MCP (Model Context Protocol) tools, enabling AIagents to securely discover and interact with enterprise systems, APIs, and data sources.
- Design agent architectures, tool-calling frameworks, retrieval mechanisms, and context management strategies.
- Collaborate with product managers, architects, and engineering teams to translate business requirements into AI-driven solutions.
- Implement Retrieval-Augmented Generation (RAG), knowledge grounding, and context orchestration patterns.
- Define evaluation frameworks and prompt testing methodologies to measure agent performance, quality, and reliability.
- Ensure AI solutions adhere to security, compliance, governance, and responsible AI standards.
- Support deployment, monitoring, troubleshooting, and continuous improvement of AI agents and MCP-enabled workflows.
- Contribute to architecture reviews, technical design documentation, and engineering best practices for AI platforms.
Required Skill
- Experience with Large Language Models (OpenAI, Azure OpenAI, Anthropic, Gemini, or equivalent).
- Strong understanding of prompt engineering, AI agent frameworks, and conversational AI systems.
- Experience building Agentic AI applications using Semantic Kernel, LangChain, LangGraph, AutoGen, CrewAI, or similar frameworks.
- Hands-on experience with MCP servers, tool integration, API orchestration, and enterprise system connectivity.
- Proficiency in Python, TypeScript, or similar programming languages.
- Familiarity with RAG architectures, vector databases, embeddings, and knowledge retrieval systems.
- Understanding of cloud platforms such as Azure AI Foundry, Azure OpenAI, AWS Bedrock, or Google Vertex AI.
- Strong problem-solving, analytical, and collaboration skills.
Preferred Qualifications
- Experience building enterprise copilots, AI assistants, or autonomous agent ecosystems.
- Knowledge of AI governance, responsible AI, and security best practices.
- Experience integrating AI agents with healthcare, health records, or regulated industry systems
All your information will be kept confidential according to EEO guidelines.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- AR

Staff AI Systems EngineerRecently posted Auto Apply
Archer · San Jose · Hybrid · Posted 13 Nov 2026 🇺🇸
DockerSQLAWS+5Technology$190k - $237k/yr - SO

Senior AI Quality & Evaluation EngineerRecently posted Auto Apply
Solvd · United States · Remote · Posted 13 Nov 2026 🇺🇸
AWSSOC 2LLM+3Salary not listed - PA

AI Enablement ManagerRecently posted Auto Apply
Patreon · San Francisco · Hybrid · Posted 13 Nov 2026 🇺🇸
WorkdaySQLGoogle Workspace+10Salary not listed - ES

Applied AI EngineerRecently posted Auto Apply
Esrtreit · New York · Hybrid · Posted 12 Nov 2026 🇺🇸
GCPGitAWS+15Technology$135k - $145k/yr - SY

Applied AI EngineerRecently posted Auto Apply
Symmetry · Seattle HQ · On-site · Posted 13 Nov 2026 🇺🇸
FastAPILLMPython+2TechnologySalary not listed - PA

Large Language Model (LLM) Systems ScientistRecently posted Auto Apply
PassiveLogic · Holladay · Hybrid · Posted 12 Nov 2026 🇺🇸
SQLSwiftGit+9Salary not listed - TT
AI Forward Deployed EngineerRecently posted Auto Apply
True Talent Solutions Partners · Washington · On-site · Posted 13 Nov 2026 🇺🇸
LLMPythonTypeScript+2$160k - $250k/yr - GE

Clinical AI Specialist (Remote)Recently posted Auto Apply
Generatorhealth · Remote · Remote · Posted 13 Nov 2026 🇺🇸
AuditingCompliancePharmacy+1Salary not listed - ET

AI Deployment StrategistRecently posted Auto Apply
Eleve Talent · New York City · Hybrid · Posted 12 Nov 2026 🇺🇸
Prompt EngineeringSalary not listed - AP
Associate Director, Nonclinical Writing AI InnovationRecently posted Auto Apply
Alnylam Pharmaceuticals · Cambridge · Hybrid · Posted 10 Nov 2026 🇺🇸
ComplianceLLMProcurement+1$156.5k/yr - AL
SG&A AI Implementation Intern Auto Apply
Astera Labs Early Career - North America 2027 · San Jose · Hybrid · Posted 30 Oct 2026 🇺🇸
ConcreteData PrivacyProcurement+3Technology$45 - $57/hr - AL
Applied AI Engineer Intern (Silicon Engineering) Auto Apply
Astera Labs Early Career - North America 2027 · San Jose · Hybrid · Posted 28 Oct 2026 🇺🇸
CADDeep LearningPython+4Technology$35 - $55/hr