Quick overview
Job description
What You'll Do
- Architect and lead development of production AI products including intelligent chatbots, document processing systems, and agentic workflows using Python and modern AI frameworks
- Design and implement our centralized AI platform including model routing, provider management, vector search, and AI application frameworks with seamless MCP (Model Context Protocol) integrations
- Build scalable AI products that integrate with diverse technologies including accounting systems, document repositories, and external APIs while maintaining robust monitoring and observability
- Master context engineering and system design for AI applications, ensuring optimal information retrieval, context assembly, and multi-turn conversation management
- Collaborate with Product, Engineering, and Security teams to ensure AI products are robust, compliant, and aligned with business objectives in the regulated accounting space
- Provide technical leadership and mentorship to the growing AI team, establishing best practices for AI product development, deployment, and governance
What You'll Bring
- 5+ years of professional software engineering experience with 4+ years focused on building backend for production applications
- Mastery of Python, Familiarity with some AI application frameworks, context engineering, and scalable system design for AI products
- Expertise in designing products that integrate with multiple technologies, APIs, and data sources in cloud-native environments (AWS preferred)
- Strong desire to develop deep hands-on experience with LLM APIs, retrieval-augmented generation (RAG), conversational AI, document processing, and MCP integrations
- Proven ability to lead tech product initiatives, establish technical standards and communicate complex system designs to both technical and business stakeholders
Nice To Haves/Other
- Experience building chatbots or conversational AI products in production
- Background in system integration, API design, or enterprise software platforms
- Familiarity with accounting workflows and financial data processing
- Experience with AI observability, debugging tools, and production AI monitoring
- Hands-on experience with advanced RAG architectures, reranking systems, and retrieval optimization techniques
- Knowledge of reinforcement learning from human feedback (RLHF) or other RL techniques for improving AI product performance
- Experience building AI platform components like embedding pipelines, semantic search systems, or multi-modal processing frameworks
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- OV

Forward Deployed EngineerRecently posted Auto Apply
Overjet · San Mateo · Hybrid · Posted 14 Nov 2026 🇺🇸
EngineeringSalary not listed - TT
Lead Software Engineer, PlatformRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
RustPythonScheduling+1Technology$220k - $320k/yr - TT
Software Engineer, MarketplaceRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
OnboardingKafkaOutreach+5Technology$250k - $300k/yr - PC
Survey and Research Programmer Auto Apply
ProSidian Consulting, LLC · Charlotte, NC · On-site 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft Word+6Salary not listed - PC
Senior Programmer Analyst Auto Apply
ProSidian Consulting, LLC · Rockville, MD · On-site 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft Word+2Operations & Project ManagementSalary not listed - PC
Junior Programmer Analyst Auto Apply
ProSidian Consulting, LLC · Rockville, MD · On-site 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft Word+1TechnologySalary not listed - PC
Engineer Auto Apply
ProSidian Consulting, LLC · Charlotte, NC · On-site 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft Word+2EngineeringSalary not listed - PC
Engineering Intern | Engineering [COC0099296] Auto Apply
ProSidian Consulting, LLC · Charlotte, NC · On-site 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft PowerPoint+2EngineeringSalary not listed - NM
Sec Systs Software Programmer Auto Apply
Northwestern Memorial Healthcare · Chicago, IL · On-site · Posted 19 Oct 2026 🇺🇸
MongoDBSQLKafka+5Technology$46 - $67/hr - BG
Service Engineer Intern Auto Apply
Bosch Group · Lincolnshire, IL · On-site 🇺🇸
Microsoft ExcelEngineering$18 - $28/hr - VE

Senior Test Engineer, CamerasRecently posted Auto Apply
Verkada · San Mateo · Hybrid · Posted 13 Nov 2026 🇺🇸
ShellGitEmbedded Systems+10Technology$150k - $220k/yr - SK
Principal Software Engineer, Lead (U.S. Air Force)Recently posted Auto Apply
Skylight · United States · Hybrid · Posted 13 Nov 2026 🇺🇸
SQLiteGitAWS+11Technology$90k - $125k/yr
