Quick overview
Job description
Design and deploy enterprise-grade AI solutions (LLMs, RAG, agents) by selecting appropriate models, building data pipelines, and integrating them with cloud platforms (AWS, Azure, GCP). Lead technical strategies across the standard 7-layer GenAI stack (from data ingestion to application interfaces), ensure scalability, manage AI security/hallucinations, and bridge business needs with engineering teams.
- System Design & Architecture: Architect end-to-end Generative AI systems by operationalizing the 7-layer AI architecture (Data Sources, Preprocessing, Model Selection, Orchestration, Inference, Integration, and Application).
- Model Selection & Tuning: Evaluate and select cutting-edge commercial (e.g., GPT-4) and open-source models, and fine-tune models for domain-specific use cases.
- LLMOps, Observability & Pipelines: Establish LLMOps standards for model versioning and CI/CD. Implement foundational observability (OBS) layers using tools like Datadog, Splunk, or Prometheus to monitor system health, API latency, and basic application metrics.
- Integration & Data Protection: Integrate AI solutions with existing APIs while enforcing core data protection measures, including Role-Based Access Control (RBAC), data encryption in transit, and basic PII (Personally Identifiable Information) masking to manage hallucinations and adversarial attacks.
- Strategic Leadership: Collaborate with stakeholders to map business challenges to AI solutions and establish AI governance frameworks.
- Client Consulting: Act as the primary onshore technical liaison, facilitating client workshops, requirements gathering, and translating business pain points into technical AI blueprints.
- Consulting Skills: Exceptional client-facing communication skills; proven ability to present complex technical concepts to business stakeholders.
- Technical Expertise: Deep knowledge of NLP, Python, deep learning frameworks (PyTorch/TensorFlow), and orchestration tools (LangChain, Autogen).
- Cloud & Data Systems: Extensive hands-on experience with AI services on AWS, Azure, or GCP. Expertise in vector databases (e.g., Pinecone, Milvus) and embedding techniques.
- Qualifications: Bachelor’s / Master’s in Computer Science, AI, Data Science, or related field; 8–15 years in software engineering, ML, or AI roles, with demonstrable onshore consulting experience.
Similar jobs
- TH

Senior Software Engineer, AI-Driven SystemsRecently posted Auto Apply
Thimble · United States · Remote 🇺🇸
MicroservicesAWSNode.js+1TechnologySalary not listed - TH

Senior Data Analyst (Product Analyst) Auto Apply
Thunkable · San Francisco · Remote 🇺🇸
SQLAmplitudeCRM+7Technology$90k - $140k/yr - TO
Senior Software Engineer Auto Apply
Toku · New York · Hybrid 🇺🇸
BlockchainPayrollGenerative AITechnologySalary not listed - TO

Software Engineer, DevOps / Infrastructure Auto Apply
Topazlabs · Dallas · On-site 🇺🇸
Deep LearningTechnology$110k - $160k/yr - TO

Software Engineer, AI Inference / HPC Auto Apply
Topazlabs · Dallas · On-site 🇺🇸
Deep LearningGenerative AITechnology$110k - $150k/yr - TO

Product Software Engineer (Full-stack) Auto Apply
Topazlabs · Dallas · On-site 🇺🇸
Deep LearningTechnologySalary not listed - TO

Technical Product Manager Auto Apply
Topazlabs · Dallas · On-site 🇺🇸
TechnologySalary not listed - G2

SERVICENOW DEVELOPER (IT CUSTOMER SUPPORT SERVICES)Recently posted Auto Apply
G2IT · Quantico · Hybrid 🇺🇸
Active DirectoryCSATLDAP+7TechnologySalary not listed - G2

Deskside Support SpecialistRecently posted Auto Apply
G2IT · O'Fallon · Hybrid 🇺🇸
WorkdayMicrosoft OfficeHelp Desk+2TechnologySalary not listed - TA

Embedded Software Engineer Auto Apply
Tag · Ashburn · Hybrid 🇺🇸
AndroidLinuxTechnology$130k - $160k/yr - TA

Senior Test and Systems Engineer Auto Apply
Tag · Ashburn · On-site 🇺🇸
AssemblyTechnology$130k - $160k/yr - TE

Principal Data Analyst Auto Apply
Tendo · Remote · Remote 🇺🇸
Process ImprovementTechnologySalary not listed
