Haystack
← Back to Jobs
Engineering
TG

Prompt Engineer

Talent GroupsNew York, NY🇺🇸United StatesPosted Oct 13, 2026

Why This Role Stands Out

This hybrid Prompt Engineer role offers a fantastic opportunity to shape the future of enterprise LLM applications, providing significant growth potential and the chance to develop cutting-edge AI skills. You'll thrive here if you possess strong LLM expertise and a passion for optimizing AI performance and safety, so don't miss out on this exciting chance to make a real impact!

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
New York, NY, United States
Posted
21 hours ago

Job Description

Key Responsibilities:

  • Design and optimize prompts, system instructions, and conversation workflows for enterprise LLM applications.
  • Develop reusable prompt templates, guardrails, and response patterns for AIRP and Copilot Studio.
  • Evaluate LLM outputs for accuracy, groundedness, hallucinations, safety, latency, and cost.
  • Improve RAG workflows, retrieval quality, and source citation behavior.
  • Conduct prompt injection, jailbreak, and sensitive-data leakage testing.
  • Implement prompt versioning, testing, monitoring, and CI/CD workflows.
  • Collaborate with engineering, business, risk, and compliance teams.

Required Skills:

  • Strong LLM and Prompt Engineering expertise.
  • RAG, embeddings, tokenization, and context-window knowledge.
  • OpenAI API, Azure OpenAI, AWS Bedrock, or Anthropic.
  • LangChain, LlamaIndex, Semantic Kernel, or Copilot Studio.
  • Prompt evaluation, security, grounding, and hallucination mitigation.
  • Strong analytical, documentation, and stakeholder-management skills.

Similar jobs