Why This Role Stands Out
This hybrid Prompt Engineer role offers a fantastic opportunity to shape the future of enterprise LLM applications, providing significant growth potential and the chance to develop cutting-edge AI skills. You'll thrive here if you possess strong LLM expertise and a passion for optimizing AI performance and safety, so don't miss out on this exciting chance to make a real impact!
Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
New York, NY, United States
Posted
21 hours ago
Job Description
Key Responsibilities:
- Design and optimize prompts, system instructions, and conversation workflows for enterprise LLM applications.
- Develop reusable prompt templates, guardrails, and response patterns for AIRP and Copilot Studio.
- Evaluate LLM outputs for accuracy, groundedness, hallucinations, safety, latency, and cost.
- Improve RAG workflows, retrieval quality, and source citation behavior.
- Conduct prompt injection, jailbreak, and sensitive-data leakage testing.
- Implement prompt versioning, testing, monitoring, and CI/CD workflows.
- Collaborate with engineering, business, risk, and compliance teams.
Required Skills:
- Strong LLM and Prompt Engineering expertise.
- RAG, embeddings, tokenization, and context-window knowledge.
- OpenAI API, Azure OpenAI, AWS Bedrock, or Anthropic.
- LangChain, LlamaIndex, Semantic Kernel, or Copilot Studio.
- Prompt evaluation, security, grounding, and hallucination mitigation.
- Strong analytical, documentation, and stakeholder-management skills.
Similar jobs
- BA
Moveworks & ServiceNow AI Technologist
Booz Allen Hamilton
McLean, VA🇺🇸$77.6k - $176k/yrOn-site4 days agoAgileLLMTechnology - RS
Hands-on GenAI Architect (Looking For W2 Candidate Only)
NewRuri Software Technologies LLC
Atlanta, GA🇺🇸On-site21 hours agoAWSAzureGenerative AI+2Technology - MP
AI Engineer
NewmProgen
Plano, TX🇺🇸Hybrid21 hours agoDockerSQLAWS+14Technology - JT
Forward Deployed AI Engineer
NewJaven Technologies, Inc
United States🇺🇸Hybrid21 hours agoBootstrap.NETLLM+1Technology - IS
Agentic AI Engineer
Innova Solutions, Inc
Charlotte, NC🇺🇸$70 - $78/hrOn-site4 days agoDockerGCPAWS+9Technology - PR
AI Technical Lead
NewPro2Serve
Lexington, KY🇺🇸Hybrid21 hours agoDockerAWSMLOps+15 - CS
AI Engineer
NewCarman Solutions Group
Atlanta, GA🇺🇸On-site21 hours agoMachine LearningScikit-learnDeep Learning+6Technology - CE
AI Developer _ Vector Database & Generative AI
NewCentraprise Corp
Pennington, NJ🇺🇸Hybrid21 hours agoAzureGPTGenerative AI+4Technology - TA
AI Lead Engineer
NewThe Avian Consulting LLC
Newark, CA🇺🇸Hybrid21 hours agoAWSBusiness AnalysisCompliance+2 - TR
Only W2: Customer-facing AI Engineer, Mountain View & Sacremento, CA (Onsite)
NewTror
New York, NY🇺🇸On-site21 hours agoDockerMicroservicesSQL+8Technology - W3
AI Engineer
NewW3Global
Santa Clara, CA🇺🇸On-site21 hours agoSnowflakeAzureGenerative AI+2Technology - PI
Full time || Gen AI Developer || Hybrid -Irving, TX
NewPioneer IT Systems LLC
Irving, TX🇺🇸Hybrid21 hours agoFastAPIFlaskMicroservices+10Technology