Haystack
← Back to Jobs
Technology
JG

Specialty Software Engineer

Judge Group, Inc.San Francisco, CA🇺🇸United StatesPosted 14 Sept 2026

Why This Role Stands Out

This on-site role offers a fantastic opportunity to shape cutting-edge Agentic AI platforms within a highly visible, strategic initiative, perfect for a skilled Python engineer eager to build scalable AI systems. You'll thrive by contributing to a transformative vision and developing advanced AI solutions in a collaborative environment.

Quick Overview

Seniority
Mid Senior
Work mode
On Site
Location
San Francisco, CA, United States
Posted
Yesterday
FastAPIMicroservicesMongoDBSQLAWSAgileAzureGenerative AIGoogle CloudKafkaLLMPythonREST

Job Description

Location: San Francisco, CA Salary: $80.00 USD Hourly - $86.00 USD Hourly Description:
Senior Software Engineer, Agentic AI & Python Platform Development

We are not accepting C2C or 1099 arrangements.

Location: San Francisco, CA (Hybrid)
Duration: Contract with potential extension/conversion
Work Authorization: H-1B candidates will be considered

About the Team

Join a highly visible and strategic AI initiative within the Consumer Technology Marketing Technology organization. This team is pioneering one of the organization's first production-scale Agentic AI platforms, developing intelligent AI agents that automate and optimize marketing campaign execution and customer engagement strategies.

Since launching earlier this year, the team has successfully delivered multiple AI agents and is now scaling the platform to support more than 20 intelligent agents across a growing portfolio of use cases. The first production deployments are already underway, creating a unique opportunity to contribute to a greenfield AI ecosystem from the ground up.
About the Role

We are seeking a highly skilled Senior Software Engineer with deep expertise in Python and distributed systems to help design, build, and scale enterprise-grade Agentic AI applications.

This is a hands-on engineering role focused on developing AI agents, backend services, and orchestration frameworks that leverage Large Language Models (LLMs) to automate complex business workflows. You will work closely with software engineers, AI architects, and product stakeholders to bring innovative AI solutions from concept to production.

The ideal candidate combines strong software engineering fundamentals with practical experience building AI-powered applications and designing scalable, fault-tolerant systems.
What You'll Do
  • Design, build, and deploy production-grade Agentic AI solutions.
  • Develop intelligent AI agents that automate marketing and customer engagement workflows.
  • Create scalable Python-based microservices and backend platforms.
  • Build and integrate RESTful APIs and event-driven architectures.
  • Develop orchestration frameworks for multi-agent AI workflows.
  • Design retrieval and knowledge systems using vector databases and semantic search.
  • Implement AI guardrails, governance controls, monitoring, and observability solutions.
  • Optimize application performance, reliability, latency, and scalability.
  • Collaborate closely with engineers and architects during daily Agile development activities.
  • Support AI systems throughout the full software development lifecycle, from design through production deployment.
Minimum Qualifications
  • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
  • 5+ years of professional software engineering experience.
  • 5+ years of Python development experience.
  • 5+ years building microservices-based applications.
  • 5+ years developing and integrating APIs.
  • 5+ years working with MongoDB or similar NoSQL databases.
  • Experience building scalable distributed systems in production environments.
  • Strong understanding of software architecture, performance optimization, and reliability engineering.
Preferred Qualifications
  • 1-2+ years of experience developing Agentic AI or Generative AI solutions.
  • Experience working with Large Language Models (LLMs).
  • Experience designing AI orchestration and multi-agent systems.
  • Familiarity with vector databases, embeddings, and semantic retrieval.
  • Experience implementing AI governance, guardrails, and responsible AI controls.
  • Cloud platform experience (Google Cloud Platform, AWS, or Azure).
  • Experience delivering solutions within regulated or highly governed environments.
  • Financial services experience is a plus but not required.
Technical Skills
Backend Engineering
  • Python
  • FastAPI
  • AsyncIO
  • Multiprocessing
  • REST APIs
  • Microservices Architecture
  • Distributed Systems
  • Event-Driven Architecture
  • Performance Tuning
  • High Availability Design
  • Fault-Tolerant Systems
  • Caching Strategies
  • Database Optimization
Generative AI & Agentic AI
  • Large Language Models (LLMs)
  • Agentic AI Frameworks
  • Multi-Agent Systems
  • Prompt Engineering
  • Prompt Orchestration
  • Tool Calling
  • LLM Routing and Fallback Strategies
  • Model Evaluation Frameworks
  • Human-in-the-Loop Validation
  • Hallucination Detection
  • Text-to-SQL Solutions
  • Retrieval-Augmented Generation (RAG)
  • Hybrid RAG Architectures
  • Knowledge Graph Enhanced RAG
AI Platform & Governance
  • Enterprise AI Architecture
  • AI Workflow Orchestration
  • Responsible AI Controls
  • AI Guardrails
  • PII Redaction
  • Audit Logging
  • Model Monitoring
  • Latency, Cost, and Accuracy Optimization
Data & Search Technologies
  • MongoDB
  • Vector Databases
  • Embeddings
  • Semantic Search
  • Re-Ranking
  • Knowledge Retrieval Systems
  • Kafka
  • Streaming Data Pipelines
Why Join
  • Work on one of the organization's flagship Agentic AI programs.
  • Build production AI solutions that directly impact customer experiences.
  • Join a collaborative, highly engaged engineering team.
  • Contribute to a greenfield platform with significant technical ownership.
  • Gain exposure to cutting-edge Generative AI, LLM, and multi-agent technologies.
  • Opportunity for contract extension and potential long-term conversion.

Work Schedule: Hybrid, approximately 3 days per week onsite (preferred onsite days: Monday, Wednesday, and Thursday, with flexibility).

Benefits Featured

Medical, Dental , and Vision Insurance is offered to qualified candidates.

Medical, dental, and vision insurance are available to qualified candidates who meet eligibility requirements.
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!

Similar jobs