Quick Overview
Job Description
Job Description
Experience
\n3-8 Years
\n\nRole Overview
\nWe are seeking a highly skilled MCP (Model Context Protocol), RAG (Retrieval-Augmented Generation), and Connectors Engineer to design, build, and optimize AI-powered solutions that integrate enterprise data sources with Large Language Models (LLMs). The ideal candidate will have hands-on experience with AI platforms, enterprise integrations, vector databases, retrieval pipelines, APIs, and modern AI application architectures.
\nThe role will focus on enabling secure, scalable, and context-aware AI experiences by developing MCP servers, building RAG pipelines, and integrating enterprise systems through custom connectors.
\n\nKey Responsibilities
\nMCP (Model Context Protocol)
\n- \n
- Design and develop MCP servers and tools for LLM-driven applications. \n
- Implement tool-calling frameworks and agent integrations. \n
- Enable secure exposure of enterprise capabilities to AI assistants. \n
- Manage authentication, authorization, and governance of MCP services. \n
- Optimize context-sharing mechanisms between AI models and enterprise systems. \n
RAG Engineering
\n- \n
- Design and implement enterprise-grade RAG architectures. \n
- Build document ingestion, chunking, embedding, indexing, and retrieval pipelines. \n
- Integrate vector databases and semantic search solutions. \n
- Improve answer quality through reranking, hybrid search, and prompt optimization. \n
- Monitor retrieval accuracy, latency, and hallucination rates. \n
- Evaluate and implement advanced retrieval techniques. \n
Connectors & Integrations
\n- \n
- Develop connectors for enterprise systems such as: \n
- SharePoint \n
- Microsoft Graph \n
- Azure Storage \n
- Salesforce \n
- ServiceNow \n
- SAP \n
- Databases (SQL/NoSQL) \n
- Internal APIs \n
- Build API integration frameworks and data synchronization pipelines. \n
- Implement event-driven and real-time data access patterns. \n
- Ensure scalability, security, and data compliance requirements. \n
AI Platform Development
\n- \n
- Collaborate with Data Scientists, AI Engineers, and Product Teams. \n
- Build reusable AI integration frameworks and SDKs. \n
- Develop observability, monitoring, and governance solutions. \n
- Implement CI/CD pipelines for AI services. \n
- Support production deployment and operational excellence. \n
Required Skills
\nAI & LLM Technologies
\n- \n
- Strong understanding of Large Language Models (GPT, Claude, Gemini, Llama, etc.) \n
- Hands-on experience with: \n
- LangChain \n
- LlamaIndex \n
- Semantic Kernel \n
- Azure AI Foundry / Azure OpenAI \n
- AI Agents and Tool Calling \n
RAG Expertise
\n- \n
- Embeddings and vector search \n
- Semantic search and hybrid retrieval \n
- Metadata filtering \n
- Document processing pipelines \n
- Evaluation frameworks for RAG systems \n
MCP Knowledge
\n- \n
- Understanding of MCP architecture and ecosystem \n
- MCP server development and tool registration \n
- Context management and agent integration \n
Integration Development
\n- \n
- REST APIs \n
- GraphQL APIs \n
- OAuth 2.0 / OpenID Connect \n
- Microsoft Graph API \n
- Enterprise system integration patterns \n
Programming Skills
\n- \n
- Python (mandatory) \n
- JavaScript / TypeScript \n
- FastAPI, Flask, Node.js \n
- SDK and API development \n
Data & Search Technologies
\n- \n
- Azure AI Search \n
- Pinecone \n
- Weaviate \n
- Chroma \n
- Elasticsearch / OpenSearch \n
- SQL and NoSQL databases \n
Cloud Platforms
\n- \n
- Microsoft Azure (preferred) \n
- AWS or Google Cloud (good to have) \n
- Docker and Kubernetes \n
- CI/CD pipelines \n
Preferred Qualifications
\n- \n
- Experience building Microsoft Copilot extensions and plugins. \n
- Experience with Copilot Studio and Microsoft Graph Connectors. \n
- Understanding of enterprise security and governance frameworks. \n
- Exposure to Agentic AI and multi-agent architectures. \n
- Knowledge of MLOps and AI observability tools. \n
- Azure AI Engineer, Azure Developer, or related certifications. \n
Success Metrics
\n- \n
- Improved retrieval accuracy and response quality. \n
- Reduced AI hallucinations through optimized RAG pipelines. \n
- Successful integration of enterprise data sources. \n
- High availability and performance of MCP services. \n
- Adoption of AI solutions across business functions. \n
Nice-to-Have Experience
\n- \n
- Microsoft 365 Copilot extensibility \n
- Graph Connectors \n
- Azure AI Search \n
- Copilot Studio \n
- OpenTelemetry \n
- Prompt Engineering \n
- Multi-Agent Systems \n
- Knowledge Graphs \n
- Event-Driven Architectures \n
Similar jobs
- SY
AI Architect (Copilot Studio)
NewSynechron
Piscataway, NJ🇺🇸$150k - $160k/yrHybrid7 hours agoAzureBlockchainStakeholder ManagementTechnology - SA
Senior Principal AI Solutions Engineer
NewSambaNova
San Jose🇺🇸$234k - $286k/yrHybrid7 hours agoNext.jsGPTLLM+3Technology - RA
Staff AI Architect
NewRobots and Pencils
US - Remote🇺🇸Remote11 hours agoMicroservicesAWSMLOps+6Technology - PR
Senior Perception Engineer
NewPronto
San Francisco🇺🇸Hybrid9 hours agoMachine LearningRoboticsComputer Vision+2Engineering - NS
AI Automation Engineer, Real-World Test Lab
NewNiantic Spatial
San Francisco🇺🇸Hybrid13 hours agoRoboticsComputer VisionLLM+1Technology - CY
AI Engineer
NewCyvl
Somerville🇺🇸On-site10 hours agoMLOpsRoboticsComputer Vision+5Technology