Why This Role Stands Out
You'll thrive in this on-site role at Sage IT Inc, where you'll be at the forefront of AI innovation, designing and optimizing prompts for cutting-edge language models. This position offers significant growth potential for skilled engineers passionate about bridging human needs with AI capabilities, allowing you to develop expertise in prompt engineering, RAG, and agentic workflows. Embrace this exciting opportunity to shape the future of AI and contribute to impactful projects within a collaborative engineering environment.
Quick Overview
Job Description
Job Description- A prompt engineer designs, tests, and optimizes instructions (prompts) for large language models (LLMs) to ensure the AI generates accurate, safe, and useful outputs.
Role Overview Primary Goal: Bridge the gap between human business needs and artificial intelligence capabilities.
Core Function: Craft system instructions, few-shot examples, and context guidelines, so AI tools produce reliable responses instead of hallucinations (false or made-up information).
Key Responsibilities Design && Optimization: Write and refine prompts for chatbots, virtual copilots, and retrieval-augmented generation (RAG) systems. Support context engineering, prompt engineering, and RAG workflows, including chunking, embeddings, semantic search, and knowledge graphs. Help build agentic workflows and AI agents with frameworks such as Google ADK, LangGraph, or CrewAI. Connect agents with external tools/data via MCP; A2A exposure is a plus. Assist with deployment, monitoring, data preprocessing, API development, and code reviews Testing && Evaluation: Test model outputs against accuracy, safety, latency (response delay), and token cost metrics. Li brary Management: Build and maintain reusable prompt templates and governance standards for enterprise teams.
Adversarial Testing: Run stress tests to check for prompt injections (tricking the AI into breaking rules), data leaks, and bias.
Cross-Functional Collaboration: Partner with data scientists, software developers, product managers, and business stakeholders. Common Qualifications && Skills AI && LLM Familiarity: Understanding of tokenization, context windows, and APIs (such as OpenAI, Anthropic, or Azure OpenAI). Python for GenAI, data preprocessing, and scripting. Core GenAI concepts: foundation models, LLMs, tokenization, embeddings, and context windows. Hands-on prompt/context engineering and practical RAG experience. Working knowledge of knowledge graphs and Graph RAG.
Exposure to agentic AI, tool-using agents, multi-step workflows, and frameworks such as ADK, LangGraph, CrewAI, or the OpenAI Agents SDK. Awareness of tool/function calling, MCP, A2A, agent harness, memory, and guardrails. Experience with GenAI APIs such as OpenAI, Gemini, and Claude; orchestration frameworks such as LangChain or LlamaIndex; Docker, Git, and AI compliance/privacy principles. Communication && Linguistics: Strong command of syntax, writing, and clear logical phrasing.
Technical Skills: Varying by role-some positions focus purely on writing and psychology, while technical roles require basic Python, SQL, or software workflow knowledge.
Similar jobs
- TN
Fellow, A.I. Initiatives
NewAuto ApplyThe New York Times
New York🇺🇸Hybrid2 hours agoSvelteMachine LearningComputer Vision+1 - AM
Summer 2027: AI Scientist Intern
NewAuto ApplyAmplify
Remote - United States🇺🇸Remote11 hours agoGCPSQLAWS+7 - GU
FP&A AI Architect
NewAuto ApplyGusto, Inc.
San Francisco🇺🇸Hybrid13 hours agoSQLSnowflakeCFA+12Technology - CL
Founding Engineer, Agents
NewAuto ApplyClera
San Francisco🇺🇸On-site10 hours agoEngineering - CL
Founding Engineer (Applied AI)
NewAuto ApplyClera
San Francisco🇺🇸On-site13 hours agoMachine LearningComputer VisionDeep Learning+1Engineering - CL
Founding Engineer, Agentic Systems
NewAuto ApplyClera
San Francisco🇺🇸On-site13 hours agoConcretePostgreSQLTypeScriptEngineering - TL

AI & Growth, US Lead
NewAuto ApplyTEAM LEWIS
Boston🇺🇸Hybrid5 hours agoBusiness DevelopmentCRMCustomer Success+4 - DA
Sr. AI Operations Specialist — Sales Operations
NewAuto ApplyDatabricks
New York; San Francisco🇺🇸$125k/yrHybrid10 hours agoSales OperationsSales - RM
Member of Applied AI Team
NewAuto ApplyRunway Ml
Remote🇺🇸Remote9 hours agoSQLRoboticsSalesforce+5 - AN
Applied AI Demo Engineer
NewAuto ApplyAnthropic
San Francisco🇺🇸$240k/yrHybrid7 hours agoConcreteGPTLLM+2 - CO
AI Engineer 5 (MLX, Agentic AI, Gen AI platform Services)
NewCapital One
New York🇺🇸$229.9k - $262.4k/yrHybrid1 hour agoScalaAWSMachine Learning+10Technology - ME
Sr. AI FDE
NewAuto ApplyMegazone
Rochester🇺🇸On-site13 hours agoAWSAzureCustomer Success+6