Back to Jobs
Recently postedTechnology

Senior Generative AI Engineer (Google Cloud Vertex AI / Gemini)

3AMIGOSIT LLCColumbus, OH🇺🇸United States

Quick overview

SeniorityMid-Senior
Work modeHybrid
LocationColumbus, OH, United States
GitMLOpsGoogle CloudLLMPythonGenerative AIRESTPrompt EngineeringCI/CDRAG

Job description

Key Responsibilities
Enterprise AI Solution Design & Development
  • Design, build, deploy, and maintain scalable, secure, and production-ready AI applications, intelligent automation workflows, document intelligence solutions, and advanced analytics capabilities.
  • Architect and optimize end-to-end Retrieval Augmented Generation (RAG) systems, including context management, document chunking strategies, embedding generation, and vector database search implementations.
  • Design and orchestrate intelligent agent-based architectures and multi-step workflows that integrate seamlessly with enterprise applications, APIs, databases, and cloud services.
  • Engineer and manage structured prompts using modern prompt engineering and prompt management frameworks to ensure reliable, deterministic, and high-accuracy outputs.
Model Strategy, Optimization & Evaluation
  • Implement dynamic model selection and routing strategies to match workloads with the optimal model based on task complexity, accuracy, latency, and cost constraints.
  • Apply token optimization and resource utilization techniques to minimize operational spend and inference latency while preserving response quality.
  • Build and execute rigorous AI evaluation frameworks, automated benchmarking pipelines, and response quality metrics to validate model performance prior to and following production release.
AI Governance, Security & Production Operations (LLMOps)
  • Implement Responsible AI controls, security guardrails, data privacy protections (including PII/PHI safeguards), and hallucination mitigation techniques tailored to healthcare and public-sector compliance standards.
  • Establish and maintain CI/CD and MLOps/LLMOps pipelines supporting automated testing, deployment, monitoring, observability, and lifecycle management of AI services.
  • Troubleshoot, debug, and optimize complex AI applications operating in production environments to ensure high availability and sustained accuracy.
Technical Leadership & Standards
  • Exercise independent technical judgment to evaluate emerging AI technologies, frameworks, and tools, determining their practical applicability and ROI for ODM business needs.
  • Establish agency-wide AI engineering standards, reusable framework components, and architectural best practices.
  • Provide technical leadership, code/design reviews, and mentorship to engineering teams adopting AI capabilities and developer productivity tools (such as GitHub Copilot).
Required Qualifications & Experience
Education & Experience
  • Bachelor’s degree in Computer Science, Artificial Intelligence, Data Science, Software Engineering, or a related technical field (or equivalent progressive experience).
  • 5+ years of hands-on software engineering experience building and deploying production enterprise applications.
  • 2+ years of recent, hands-on experience designing, developing, deploying, and maintaining Generative AI / LLM solutions in enterprise cloud environments.
Technical Competencies
  • AI Platforms & Models: Practical experience working with enterprise AI platforms and foundation models—specifically Google Cloud Vertex AI and Gemini models (experience with GitHub Copilot in enterprise engineering workflows is a strong plus).
  • RAG & Retrieval Systems: Deep proficiency in embeddings, vector databases, semantic/hybrid search, chunking strategies, and context window management.
  • LLM Engineering & Orchestration: Hands-on expertise in prompt engineering, model routing/orchestration frameworks, agent-based workflows, and structured output generation.
  • Evaluation, Guardrails & Observability: Proven experience implementing automated LLM evaluation/benchmarking, telemetry/observability, hallucination reduction, and AI security/privacy guardrails.
  • Software Engineering & MLOps: Strong proficiency in Python and modern software engineering practices, REST/event-driven APIs, cloud-native infrastructure, containerization, and CI/CD pipelines for AI lifecycle management.
Core Competencies
  • Strong independent technical judgment capable of balancing solution accuracy, response quality, latency, security, and operational cost.
  • Analytical problem-solving skills to diagnose non-deterministic model behavior and complex distributed-system bottlenecks in production.
  • Clear communication skills to translate complex AI capabilities, trade-offs, and risk mitigation strategies for both technical teams and agency leadership.

Will your resume get past this employer's screening? Check your resume against this job, free

Similar jobs