Why this role stands out
Step into a leadership role where you will define the technical strategy for cutting-edge AI systems while enjoying the flexibility of a fully remote environment. You will thrive in this position if you are an experienced architect passionate about scaling generative AI and distributed systems within a fast-growing, innovative organization. Apply today to take full ownership of high-impact AI initiatives and advance your career at the forefront of technology.
Quick overview
Job description
As a Principal AI Engineer, you will be responsible for defining and executing the technical strategy for machine learning operations, generative AI infrastructure, and intelligent application platforms. You'll work across cloud architecture, distributed systems, AI deployment, and platform engineering to ensure scalable, secure, and reliable AI services.
This role offers significant technical ownership for an engineer who enjoys solving difficult architecture problems, leading large initiatives, and bringing cutting-edge AI capabilities into production environments. You will partner with engineering, data, security, and product teams to create platforms that support everything from model deployment and inference to observability, governance, and optimization. Required Skills & Experience
- 10+ years of software engineering, cloud infrastructure, or platform engineering experience
- Strong track record designing and supporting large-scale distributed systems
- Experience serving as a technical lead, architect, principal engineer, or similar senior-level contributor
- Extensive experience developing and operating AI/ML platforms in production environments
- Hands-on experience deploying and supporting Large Language Models (LLMs) at scale
- Deep understanding of Retrieval-Augmented Generation (RAG), embeddings, vector search, prompt management, and AI orchestration
- Expert-level Python and TypeScript development skills
- Experience building secure, scalable APIs and backend services
- Strong knowledge of AWS cloud services and containerized workloads
- Experience with Infrastructure as Code using CloudFormation, CDK, or comparable frameworks
- Understanding of CI/CD methodologies and automation practices
- Expertise implementing observability solutions including monitoring, alerting, logging, and distributed tracing
- Experience securing multi-tenant platforms and managing sensitive data requirements
- Excellent communication skills with the ability to influence technical direction across teams
- Experience with advanced LLM orchestration and agent frameworks
- Knowledge of AI evaluation pipelines, model testing strategies, and quality measurement systems
- Familiarity with AI cost optimization, GPU utilization, and inference efficiency techniques
- Experience designing agent-based applications and tool-calling workflows
- Exposure to multimodal AI solutions involving image, laboratory, or scientific datasets
- Understanding of model optimization techniques including fine-tuning, quantization, and distillation
- Experience supporting regulated environments with strict compliance requirements
- Background in life sciences, healthcare, scientific research, or laboratory technology domains
- Lead architectural decisions for enterprise AI and machine learning platforms
- Design and evolve infrastructure supporting model deployment, governance, and scalability
- Build solutions for both real-time inference and large-scale batch processing workloads
- Define standards for model lifecycle management, versioning, promotion, and rollback
- Create secure frameworks for AI systems operating across multi-tenant environments
- Develop processes that ensure AI outputs meet quality, performance, and reliability objectives
- Implement monitoring and observability solutions for production AI systems
- Drive improvements in system performance, resiliency, scalability, and operational efficiency
- Collaborate with software engineers, data teams, and security stakeholders on platform initiatives
- Establish best practices for AI engineering, architecture, and deployment
- Lead technical design reviews and mentor engineers across multiple teams
- Evaluate emerging AI technologies and recommend strategic adoption opportunities
- Support infrastructure automation and cloud-native deployment processes
- Competitive compensation package
- Fully remote position for candidates located in Connecticut
- Opportunity to influence the direction of a rapidly growing AI platform
- High-visibility leadership role with substantial architectural ownership
- Collaborative engineering culture focused on innovation and continuous improvement
- Medical Insurance
- Dental Benefits
- Vision Benefits
- Unlimited Paid Time Off (PTO)
- 401(k)
- Life Insurance
- Short-Term Disability Coverage
- Long-Term Disability Coverage
Similar jobs
- TU

AI Engineer – Manufacturing & ProductionRecently posted Auto Apply
Tutorintelligence · Watertown · On-site · Posted 16 Nov 2026 🇺🇸
SQLRoboticsCAD+5Manufacturing$150k - $190k/yr - BE
Artificial Intelligence EngineerRecently posted
BeaconFire Inc. · Mundelein, Illinois · Hybrid · Posted 16 Nov 2026 🇺🇸
ScrumGenerative AIAgileEngineering$62k - $80k/yr - TT
Founding AI Agent EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
RecruitingClinical TrialsOutreach+2$150k - $220k/yr - TT
AI SchedulerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
BIMConstruction ManagementPrimavera P6+2$140k - $200k/yr - TT
Founding AI EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 15 Nov 2026 🇺🇸
Next.jsPlaywrightNode.js+1Technology$216k - $250k/yr - HA
AI Solutions EngineerRecently posted
Harris · TN · Hybrid · Posted 15 Nov 2026 🇺🇸
HIPAAGenerative AICI/CDTechnology$110k - $150k/yr - ER

Head of Applied AI Auto Apply
Eragon · San Francisco · On-site · Posted 30 Oct 2026 🇺🇸
$350k - $500k/yr - OR
Research Engineer, AIRecently posted Auto Apply
Orbis · Remote - US · Remote · Posted 13 Nov 2026 🇺🇸
LLMPythonMachine LearningEngineeringSalary not listed - OR
Research Engineer, AI (Entry-Level) Auto Apply
Orbis · Remote - US · Remote · Posted 3 Nov 2026 🇺🇸
DockerLLMPython+2Salary not listed - WI
AI Value Delivery Lead (Partner Motion) Auto Apply
Within.ai · San Francisco (HQ) · On-site 🇺🇸
Six SigmaGenerative AISlackOperations & Project ManagementSalary not listed - CO

AI Engineer 4 (MLX, Agentic AI, Gen AI platform Services)Recently posted
Capital One · New York · Hybrid 🇺🇸
ScalaAWSC#+11Technology$197.3k - $225.1k/yr - CO

AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)Recently posted
Capital One · Mc Lean, Virginia · Hybrid 🇺🇸
ScalaAWSC#+11Technology$229.9k - $262.4k/yr
