Quick overview
Job description
Senior Generative AI Developer
NC DHHS requires the services of a Senior Generative AI Developer who is responsible for designing, developing, and deploying production-grade Artificial Intelligence solutions leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), fine-tuning techniques, and secure enterprise data systems. The developer ensures all AI solutions adhere to organizational standards for security, privacy, compliance, and Responsible AI principles. This position collaborates with engineering, security, data, product, and governance teams to advance scalable, ethical, and secure AI adoption across the organization.
Responsibilities
- Build and deploy LLM-driven features, prompts, and agent workflows.
- Customize models using fine-tuning and adapter techniques.
- Develop RAG pipelines using vector, SQL, and NoSQL databases.
- Manage secure ingestion of enterprise content with proper metadata and PII protection.
- Use relational, NoSQL, and vector databases to support AI workloads.
- Apply performance tuning, access control, encryption, and compliant data handling.
- Implement AI safety controls and secure model access.
- Ensure Responsible AI practices include bias, fairness, and privacy reviews.
- Build secure, scalable microservices to integrate AI features into applications.
- Implement best practices for reliability, error handling, and observability.
- Maintain CI/CD pipelines for models and AI services.
- Monitor performance, cost, and drift.
- Support documentation and audit readiness.
Requirements
<>Required Skills & Experience- Hands-on experience in applied machine learning or Generative AI development. Required 3 Years
- Experience working with a major cloud platform (Azure, AWS, or Google Cloud Platform). Required 3 Years
- Python development, including experience with LLM frameworks (LangChain, Semantic Kernel, LangGraph). Required 3 Years
- Experience building RAG pipelines or LLM-driven applications. Required 2 Years
- Experience with vector databases (Pinecone, Weaviate, Milvus, FAISS) and retrieval optimization. Required 2 Years
- SQL experience, including data modeling, transformations, and performance tuning. Required 5 Years
- Experience with NoSQL/document databases (MongoDB, Cosmos DB, DynamoDB). Required 2 Years
- Experience implementing AI security controls such as encryption, RBAC, API security, and secret management. Required 2 Years
- Experience applying Responsible AI principles, including bias testing, hallucination mitigation, and privacy safeguards. Required 2 Years
- Experience building and integrating microservices using FastAPI, Node.js, or Azure Functions. Required 5 Years
- Experience with Agile (Scrum, Kanban, or SAFe) development. Required 3 Years
- Ability to organize, prioritize, and follow complex and/or detailed technical procedures. Required 3 Years
- Experience with Azure AI Search, Azure Machine Learning, Databricks, or HuggingFace. Desired 2 Years
- Familiarity with Promptflow, Ragas, or similar automated evaluation tools. Desired 2 Years
- Experience designing supervised fine-tuning workflows or LoRA-based training pipelines. Desired 2 Years
- Familiarity with enterprise governance tools such as Microsoft Purview or similar compliance platforms. Desired 2 Years
- Certifications such as Azure AI-102, AWS ML Specialty, Google Cloud Platform ML Engineer, SC-100, or Responsible AI coursework. Desired 2 Years
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- IS
Python AI/ML EngineerRecently posted
IT Solutions · Malvern, PA · Hybrid · Posted 20 Nov 2026 🇺🇸
FastAPIAWSPython+1TechnologySalary not listed - TA

Software Engineer / AI & Machine Learning Engineer with Security ClearanceRecently posted
TalentOps · Chantilly, VA · Hybrid · Posted 17 Nov 2026 🇺🇸
HTMLApacheMachine Learning+1TechnologySalary not listed - TE
AI/ML Engineer - Denver, CO, Phoenix, AZ, St. Louis, MO, Nashville, TN, Kansas City, KS.Recently posted
TechniPros, LLC · Denver, CO · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerFastAPISQL+13TechnologySalary not listed - QU
AI/ML Engineer – Vertex AI - Denver, CO, Phoenix, AZ, St. Louis, MO, Nashville, TN, Kansas City, KS.Recently posted
QTech US Inc · Denver, CO · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerFastAPISQL+13TechnologySalary not listed - PS
Senior Machine Learning EngineerRecently posted
Precision System Design Inc. · Cleveland, OH · Remote · Posted 20 Nov 2026 🇺🇸
DockerSQLAWS+8TechnologySalary not listed - TE
AI/ML Engineer - Chicago, IL, Minneapolis, MN, Detroit, MI, Madison, WI, Columbus, OH.Recently posted
TechniPros, LLC · Chicago, IL · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerSQLGit+21TechnologySalary not listed - RI

Engineering Intern - ML Compilers (Spring 2027 Co-op)
Rivian · Palo Alto, CA · On-site · Posted 22 Oct 2026 🇺🇸
RecruitingSpringBackground Checks+7$45 - $51/hr - NG

Fulltime Job -Machine Learning Engineer-Irving, TXRecently posted
Newt Global · Irving, TX · Hybrid · Posted 20 Nov 2026 🇺🇸
Stakeholder ManagementMachine LearningTechnologySalary not listed - BA

AI/ML EngineerRecently posted
Booz Allen Hamilton · San Diego, CA · On-site · Posted 19 Nov 2026 🇺🇸
DockerAWSScikit-learn+11Technology$77.6k - $176k/yr - IT

AI/ML EngineerRecently posted
IT Trailblazers, LLC. · Sunnyvale, CA · Hybrid · Posted 19 Nov 2026 🇺🇸
C++PyTorchPython+2TechnologySalary not listed - ST
AI/ML EngineerRecently posted
Saim Technologies · United States · Remote · Posted 19 Nov 2026 🇺🇸
MicroservicesMLOpsPython+3TechnologySalary not listed - AS
ML Engineer
Apex Systems · Cleveland, OH · Hybrid 🇺🇸
DockerGitMLOps+13TechnologySalary not listed