Back to Jobs
Recently postedTechnology

Senior Generative AI Engineer - LLM, RAG & Python

Rose InternationalRaleigh, NC🇺🇸United States

Quick overview

Salary$70 - $80/hr
SeniorityMid Senior
Work modeOn Site
LocationRaleigh, NC, United States
SAFeDynamoDBFastAPIMicroservicesMongoDBSQLAWSEncryptionScrumDatabricksGoogle CloudKanbanLLMPythonGenerative AIAzureNode.jsMachine LearningAgileCI/CDLangChainLangGraphRAG

Job description

Date Posted: 11/19/2026
Hiring Organization: Rose International
Position Number: 511071
Industry: Government/Staffing
Job Title: Senior Generative AI Engineer - LLM, RAG & Python
Job Location: Raleigh, NC, USA, 27607
Work Model: Hybrid
Work Model Details: Onsite 2 days a week
Shift: 8 AM to 5 PM EST, Monday through Friday
Employment Type: Temporary
FT/PT: Full-Time
Estimated Duration (In months): 13
Min Hourly Rate($): 70.00
Max Hourly Rate($): 80.00
Must Have Skills/Attributes: AWS, Azure, Cloud, Google Cloud Platform, Generative AI/GenAI, LLM (Large Language Model), Machine Learning, MongoDB, NoSQL, Python, RAG (Retrieval-Augmented Generation)
Experience Desired:
Hands-on experience in applied machine learning or Generative AI development (3 yrs),
Python development, including experience with LLM frameworks (LangChain, Semantic Kernel, LangGraph) (3 yrs),
Experience building RAG pipelines or LLM-driven applications (2 yrs),
Experience with vector databases (Pinecone, Weaviate, Milvus, FAISS) and retrieval (2 yrs),
SQL experience including data modeling, transformations, and performance tuning (5 yrs),
Experience implementing AI security controls such as encryption, RBAC, API security, and secret management (2 yrs),
Experience building and integrating microservices using FastAPI, Node.js, or Azure Functions (5 yrs)
Preferred Certifications/Licenses: Azure AI-102, AWS ML Specialty, Google Cloud Platform ML Engineer, SC-100, or Responsible AI coursework
Job Description
Preferred Certifications:
Certifications such as Azure AI-102, AWS ML Specialty, Google Cloud Platform ML Engineer, SC-100, or Responsible AI coursework

Required Skills

Hands-on experience in applied machine learning or Generative AI development (3 Years)
Experience working with a major cloud platform (Azure, AWS, or Google Cloud Platform) (3 Years)
Python development, including experience with LLM frameworks (LangChain, Semantic Kernel, LangGraph) (3 Years)
Experience building RAG pipelines or LLM-driven applications (2 Years)
Experience with vector databases (Pinecone, Weaviate, Milvus, FAISS) and retrieval optimization (2 Years)
SQL experience including data modeling, transformations, and performance tuning (5 Years)
Experience with NoSQL/document databases (MongoDB, Cosmos DB, DynamoDB) (2 Years)
Experience implementing AI security controls such as encryption, RBAC, API security, and secret management (2 Years)
Experience applying Responsible AI principles including bias testing, hallucination mitigation, and privacy safeguards (2 Years)
Experience building and integrating microservices using FastAPI, Node.js, or Azure Functions (5 Years)
Experience with Agile (Scrum, Kanban, or SAFe) development (3 Years)
Ability to organize, prioritize, and follow complex and/or detailed technical procedures (3 Years)
Preferred Skills:
Experience with Azure AI Search, Azure Machine Learning, Databricks, or HuggingFace (2 Years)
Familiarity with Promptflow, Ragas, or similar automated evaluation tools (2 Years)
Experience designing supervised finetuning workflows or LoRA-based training pipelines (2 Years)
Familiarity with enterprise governance tools such as Microsoft Purview or similar compliance platforms (2 Years)
Our client is seeking a Senior Generative AI Developer to design, develop, and deploy production-grade AI solutions using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), fine-tuning techniques, and secure enterprise data systems.

The role requires strong technical skills in Python, cloud-native development, data engineering, and the integration of structured and unstructured databases into AI systems. The developer ensures all AI solutions adhere to organizational standards for security, privacy, compliance, and Responsible AI principles.

This position collaborates with engineering, security, data, product, and governance teams to advance scalable, ethical, and secure AI adoption across the organization
Job Duties:
Build and deploy LLM-driven features, prompts, and agent workflows
Customize models using fine-tuning and adapter techniques
Develop RAG pipelines using vector, SQL, and NoSQL databases
Manage secure ingestion of enterprise content with proper metadata and PII protection
Use relational, NoSQL, and vector databases to support AI workloads
Apply performance tuning, access control, encryption, and compliant data handling
Implement AI safety controls and secure model access
Ensure Responsible AI practices include bias, fairness, and privacy reviews
Build secure, scalable microservices to integrate AI features into applications
Implement best practices for reliability, error handling, and observability
Maintain CI/CD pipelines for models and AI services
Monitor performance, cost, and drift
Support documentation and audit readiness
Additional Details:
An in-person interview is required
Benefits:
For information and details on employment benefits offered with this position, please visit here.

Should you have any questions/concerns, please contact our HR Department via our secure website.

California Pay Equity

For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.
Rose International is an

Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.

If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department. Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).

Will your resume get past this employer's screening? Check your resume against this job, free

Similar jobs