Quick Overview
Job Description
About the Role
Join a fast-moving, pre-seed-backed AI startup building the next generation of agentic systems that automate complex, multi-step workflows across regulated and enterprise domains — including healthcare, legal, fintech, logistics, and compliance. As a mid-level AI Engineer on the core product team, you'll own production LLM-based services end-to-end, collaborate closely with founders and product, and ship features that deliver measurable impact for real users.
What You'll Do
Design, build, and maintain agentic systems that automate complex, multi-step workflows across regulated industries.
Own production retrieval-augmented generation (RAG) pipelines and retrieval infrastructure, including vector databases, embeddings, and indexing for domain-specific search at scale.
Implement multi-agent orchestration, tool-calling, memory, and reasoning components to deliver robust AI-driven user experiences.
Develop evaluation and safety infrastructure to measure model performance, surface regressions, and enforce enterprise-level trust and reliability.
Ship full-stack AI products from MVP to enterprise-grade — designing APIs and data models, writing frontend and backend code, and operating production systems with CI/CD, monitoring, and testing.
Collaborate with founders, product, and design to prioritize work, define success metrics, and iterate based on user feedback and telemetry.
What We're Looking For
Must-haves:
2–8 years of software engineering experience with demonstrated delivery of shipped user-facing or backend products.
Practical experience deploying LLMs or LLM-based services in production, including prompt design, orchestration, and tool integration.
Proficiency across the stack: Python plus TypeScript/React (or equivalent), cloud platforms (AWS or GCP), and relational or NoSQL databases.
Working knowledge of RAG patterns, vector databases, embeddings, and retrieval pipelines, with sound judgment on when to apply each approach.
Experience building automated tests, evaluations, and monitoring for AI systems to ensure reliability beyond demos.
Experience designing API-driven, high-throughput systems and real-time product features.
Nice-to-haves:
Experience with agent or workflow frameworks (e.g., LangGraph, CrewAI) and orchestration tools (e.g., Temporal, Trigger).
Familiarity with fine-tuning, parameter-efficient tuning, or multi-modal model integration.
Background building multi-tenant or enterprise-ready systems, or prior experience in regulated industries such as healthcare, fintech, or legal.
Compensation & Benefits
Salary: $180,000 – $400,000 USD annually (reflecting a wide band across base and equity depending on experience).
Early-stage equity in a venture-backed startup.
Similar jobs
- TI
Principal Game AI Engineer
NewAuto ApplyTake-Two Interactive Software, Inc.
Massachusetts🇺🇸Hybrid11 hours agoOnboardingC#C+++3Technology - GS
Principal Game AI Engineer
NewAuto ApplyGhost Story Games
Massachusetts🇺🇸$180k/yrHybrid11 hours agoOnboardingC#C+++3Technology - PR
AI Transformation Lead
NewAuto ApplyPraecipio
Chicago🇺🇸Remote14 hours agoGitGenerative AI - CI
Senior AI Product Engineer
NewAuto ApplyCitian
Washington D.C.🇺🇸Hybrid12 hours agoSQLAWSSOC 2+10 - TN
Fellow, A.I. Initiatives
NewAuto ApplyThe New York Times
New York🇺🇸$82.4k/yrHybrid21 hours agoSvelteMachine LearningComputer Vision+2 - AM
Summer 2027: AI Scientist Intern
NewAuto ApplyAmplify
Remote - United States🇺🇸RemoteYesterdayGCPSQLAWS+8 - GU
FP&A AI Architect
NewAuto ApplyGusto, Inc.
San Francisco🇺🇸HybridYesterdaySQLSnowflakeCFA+15Technology - CL
Founding Engineer, Agents
NewAuto ApplyClera
San Francisco🇺🇸On-siteYesterdayEngineering - CL
Founding Engineer (Applied AI)
NewAuto ApplyClera
San Francisco🇺🇸On-siteYesterdayMachine LearningComputer VisionDeep Learning+1Engineering - CL
Founding Engineer, Agentic Systems
NewAuto ApplyClera
San Francisco🇺🇸On-siteYesterdayConcretePostgreSQLTypeScriptEngineering - TL

AI & Growth, US Lead
NewAuto ApplyTEAM LEWIS
Boston🇺🇸$150k - $190k/yrHybridYesterdayCRMCustomer SuccessForecasting+4 - DA
Sr. AI Operations Specialist — Sales Operations
NewAuto ApplyDatabricks
New York; San Francisco🇺🇸$125k/yrHybridYesterdaySales OperationsMicrosoft ExcelSales