Haystack
← Back to Jobs
Engineering

Prompt Engineer

Info Way SolutionsToronto, ON🇺🇸United StatesPosted 7 Aug 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Job Summary

We are seeking an experienced Prompt Engineer with expertise in Generative AI, Large Language Models (LLMs), and Enterprise AI platforms. The ideal candidate will have hands-on experience designing, optimizing, and evaluating prompts that improve the accuracy, reliability, and performance of AI-powered applications.

The candidate will work closely with AI Engineers, Data Scientists, Product Owners, and Business Stakeholders to build enterprise-grade Generative AI solutions, develop prompt libraries, evaluate LLM performance, and integrate AI capabilities into business workflows.


Key Responsibilities

  • Design, develop, and optimize prompts for enterprise Large Language Model (LLM) applications.
  • Build prompt templates, prompt chains, and reusable prompt libraries for various business use cases.
  • Evaluate prompt performance and continuously improve response quality, accuracy, and consistency.
  • Collaborate with AI Engineers and Data Scientists to integrate prompts into AI-powered applications.
  • Perform prompt testing, benchmarking, A/B testing, and output evaluation.
  • Work with Retrieval-Augmented Generation (RAG) pipelines to improve response relevance.
  • Develop prompt engineering best practices, documentation, and governance standards.
  • Integrate prompts with APIs, chatbots, virtual assistants, and enterprise applications.
  • Ensure responsible AI usage, data privacy, and security compliance.
  • Stay current with emerging LLM technologies, prompt engineering techniques, and Generative AI advancements.

Required Skills & Qualifications

  • Bachelor''s degree in Computer Science, Artificial Intelligence, Data Science, Information Technology, or related field.
  • 5+ years of overall software development or AI experience.
  • 2+ years of hands-on Prompt Engineering experience with Enterprise LLM platforms.
  • Strong understanding of:
    • Prompt Engineering
    • Generative AI
    • Large Language Models (LLMs)
    • Natural Language Processing (NLP)
  • Experience with:
    • OpenAI GPT Models
    • Azure OpenAI
    • Anthropic Claude
    • Google Gemini
    • Meta Llama
  • Experience building AI chatbots and virtual assistants.
  • Knowledge of Python for AI application development.
  • Experience with REST APIs and AI service integrations.
  • Strong analytical, problem-solving, and communication skills.
  • Experience working in Agile/Scrum environments.

Preferred Skills

  • LangChain
  • LangGraph
  • LlamaIndex
  • Retrieval-Augmented Generation (RAG)
  • Vector Databases (Pinecone, FAISS, ChromaDB, Weaviate)
  • Semantic Search
  • AI Agents
  • Function Calling / Tool Calling
  • Prompt Evaluation Frameworks
  • Hugging Face Transformers
  • MLflow
  • Docker
  • Kubernetes
  • Git
  • CI/CD
  • AWS Bedrock
  • Azure AI Foundry
  • Google Vertex AI

Technology Environment

  • Prompt Engineering
  • Large Language Models (LLMs)
  • OpenAI / Azure OpenAI
  • Anthropic Claude
  • Google Gemini
  • Meta Llama
  • Python
  • LangChain
  • LangGraph
  • LlamaIndex
  • RAG (Retrieval-Augmented Generation)
  • Vector Databases
  • NLP
  • REST APIs
  • AI Agents
  • Git
  • Docker
  • Kubernetes
  • CI/CD
  • AWS / Azure / Google Cloud Platform
  • Agile / Scrum

Skills

Scrum
Agile

Similar jobs