Quick overview
Job description
Date Posted: 11/19/2026
Hiring Organization: Rose International
Position Number: 511071
Industry: Government/Staffing
Job Title: Senior Generative AI Engineer - LLM, RAG & Python
Job Location: Raleigh, NC, USA, 27607
Work Model: Hybrid
Work Model Details: Onsite 2 days a week
Shift: 8 AM to 5 PM EST, Monday through Friday
Employment Type: Temporary
FT/PT: Full-Time
Estimated Duration (In months): 13
Min Hourly Rate($): 70.00
Max Hourly Rate($): 80.00
Must Have Skills/Attributes: AWS, Azure, Cloud, Google Cloud Platform, Generative AI/GenAI, LLM (Large Language Model), Machine Learning, MongoDB, NoSQL, Python, RAG (Retrieval-Augmented Generation)
Experience Desired:
Hands-on experience in applied machine learning or Generative AI development (3 yrs),
Python development, including experience with LLM frameworks (LangChain, Semantic Kernel, LangGraph) (3 yrs),
Experience building RAG pipelines or LLM-driven applications (2 yrs),
Experience with vector databases (Pinecone, Weaviate, Milvus, FAISS) and retrieval (2 yrs),
SQL experience including data modeling, transformations, and performance tuning (5 yrs),
Experience implementing AI security controls such as encryption, RBAC, API security, and secret management (2 yrs),
Experience building and integrating microservices using FastAPI, Node.js, or Azure Functions (5 yrs)
Preferred Certifications/Licenses: Azure AI-102, AWS ML Specialty, Google Cloud Platform ML Engineer, SC-100, or Responsible AI coursework
Job Description
Preferred Certifications:
Certifications such as Azure AI-102, AWS ML Specialty, Google Cloud Platform ML Engineer, SC-100, or Responsible AI coursework
Required Skills
Hands-on experience in applied machine learning or Generative AI development (3 Years)
Experience working with a major cloud platform (Azure, AWS, or Google Cloud Platform) (3 Years)
Python development, including experience with LLM frameworks (LangChain, Semantic Kernel, LangGraph) (3 Years)
Experience building RAG pipelines or LLM-driven applications (2 Years)
Experience with vector databases (Pinecone, Weaviate, Milvus, FAISS) and retrieval optimization (2 Years)
SQL experience including data modeling, transformations, and performance tuning (5 Years)
Experience with NoSQL/document databases (MongoDB, Cosmos DB, DynamoDB) (2 Years)
Experience implementing AI security controls such as encryption, RBAC, API security, and secret management (2 Years)
Experience applying Responsible AI principles including bias testing, hallucination mitigation, and privacy safeguards (2 Years)
Experience building and integrating microservices using FastAPI, Node.js, or Azure Functions (5 Years)
Experience with Agile (Scrum, Kanban, or SAFe) development (3 Years)
Ability to organize, prioritize, and follow complex and/or detailed technical procedures (3 Years)
Preferred Skills:
Experience with Azure AI Search, Azure Machine Learning, Databricks, or HuggingFace (2 Years)
Familiarity with Promptflow, Ragas, or similar automated evaluation tools (2 Years)
Experience designing supervised finetuning workflows or LoRA-based training pipelines (2 Years)
Familiarity with enterprise governance tools such as Microsoft Purview or similar compliance platforms (2 Years)
Our client is seeking a Senior Generative AI Developer to design, develop, and deploy production-grade AI solutions using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), fine-tuning techniques, and secure enterprise data systems.
The role requires strong technical skills in Python, cloud-native development, data engineering, and the integration of structured and unstructured databases into AI systems. The developer ensures all AI solutions adhere to organizational standards for security, privacy, compliance, and Responsible AI principles.
This position collaborates with engineering, security, data, product, and governance teams to advance scalable, ethical, and secure AI adoption across the organization
Job Duties:
Build and deploy LLM-driven features, prompts, and agent workflows
Customize models using fine-tuning and adapter techniques
Develop RAG pipelines using vector, SQL, and NoSQL databases
Manage secure ingestion of enterprise content with proper metadata and PII protection
Use relational, NoSQL, and vector databases to support AI workloads
Apply performance tuning, access control, encryption, and compliant data handling
Implement AI safety controls and secure model access
Ensure Responsible AI practices include bias, fairness, and privacy reviews
Build secure, scalable microservices to integrate AI features into applications
Implement best practices for reliability, error handling, and observability
Maintain CI/CD pipelines for models and AI services
Monitor performance, cost, and drift
Support documentation and audit readiness
Additional Details:
An in-person interview is required
Benefits:
For information and details on employment benefits offered with this position, please visit here.
Should you have any questions/concerns, please contact our HR Department via our secure website.
California Pay Equity
For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.
Rose International is an
Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.
If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department. Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- CS

Forward Deployed AI Solutions EngineerRecently posted
Cynet Systems · Ohio City, OH · Hybrid · Posted 19 Nov 2026 🇺🇸
Microsoft OfficeSOC 2Generative AI+2Technology$65 - $70/hr - II
AI Engineer - Malvern, PARecently posted
Innovative IT Solutions Inc · Malvern, PA · Hybrid · Posted 19 Nov 2026 🇺🇸
AWSLLMPython+5TechnologySalary not listed - CS

Senior Generative AI DeveloperRecently posted
Cynet Systems · Raleigh, NC · Hybrid · Posted 19 Nov 2026 🇺🇸
MicroservicesSQLEncryption+7Technology$75 - $80/hr - RE

AI/ML ArchitectRecently posted
Relanto, Inc. · San Jose, CA · Hybrid · Posted 19 Nov 2026 🇺🇸
DjangoDockerFastAPI+16TechnologySalary not listed - PR
Agentic AI ArchitectRecently posted
Prohires · Sunnyvale, CA · Hybrid · Posted 19 Nov 2026 🇺🇸
MicroservicesAWSGPT+9TechnologySalary not listed - PR
Ai ArchitectRecently posted
Prohires · Sunnyvale, CA · Hybrid · Posted 19 Nov 2026 🇺🇸
MicroservicesLLMGenerative AI+4TechnologySalary not listed - KS

Gen AI DeveloperRecently posted
Keypixel Software Solutions · United States · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerFastAPIOAuth+10TechnologySalary not listed - CT
AI Engineer (JNR LEVEL)Recently posted
CogniSoft Technologies · Washington, DC · On-site · Posted 19 Nov 2026 🇺🇸
DatabricksRAGTechnologySalary not listed - 3S

Senior Generative AI DeveloperRecently posted
3Core Systems, Inc · Raleigh, NC · On-site · Posted 19 Nov 2026 🇺🇸
SQLEncryptionLLM+3TechnologySalary not listed - IN
AI EngineerRecently posted
Infoyogi LLC · Austin, TX · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerFastAPISQL+26TechnologySalary not listed - IN
Gen AI DeveloperRecently posted
Innosoul inc · Raleigh, NC · Hybrid · Posted 19 Nov 2026 🇺🇸
SAFeDynamoDBFastAPI+20TechnologySalary not listed - HT

Senior Generative AI DeveloperRecently posted
HonorVet Technologies · Raleigh, NC · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerDynamoDBMicroservices+23TechnologySalary not listed