Customer Support, Success & Billing Ops Domain Expert (QA & Evaluation)
Quick overview
Job description
(JD) - Customer Support, Success & Billing Ops Domain Expert (QA & Evaluation)
Role Overview
We are seeking experienced B2B SaaS Customer Support, Customer Success, and Billing Operations practitioners to evaluate complex enterprise AI tasks, workflow resolution quality, and grading rubrics. As a hands-on Domain Expert, you will act as a senior evaluator reviewing real-world SaaS operational scenarios, ensuring task realism, policy compliance, and rigorous quality standards across multi-application SaaS ecosystems.
Qualifications & Core Experience
- Years of Experience: 5+ years of direct, hands-on post-sales operational experience in a B2B SaaS environment.
- Role Background: Proven background in one of the following specialized sub-roles:
- Tier 2/3 Technical Support Engineer owning end-to-end ticketing, triage, bug reproduction, and engineering escalations.
- Senior Enterprise CSM managing accounts, renewals, QBRs, churn mitigation, and executive sponsor relationships.
- CS Ops / Health & Adoption Lead running customer health scoring, retention modeling, and product utilization reporting.
- Subscription Billing Support Lead managing invoice disputes, dunning, failed payments, and refund policies in Stripe or equivalent systems.
- Education & Credentials: Bachelor's degree in Business, Information Systems, Computer Science, or equivalent practical industry experience.
Mandatory Technical & Operational Skills
- SaaS Stack Fluency: Daily operational proficiency with tools such as Intercom, Zendesk, Salesforce, HubSpot, Stripe (or Chargebee/Zuora), Metabase/Looker/Gainsight, Slack, Notion, and Google Workspace / Microsoft Office.
- Multi-System QA & Audit Acumen: Demonstrated ability to audit multi-step enterprise workflows by cross-referencing and reconciling conflicting data across 3+ business platforms simultaneously.
- Policy & Restraint Guardrails: Strong capability to audit grading rubrics to flag unauthorized refunds, credits, contract repricings, data/ACL leaks, or unapproved external communications.
- Scenario & Prompt Validation: Ability to craft and validate authentic, non-synthetic task scenarios and prompt evaluations that reflect realistic enterprise SaaS challenges.
Preferred Qualifications
- Experience evaluating or training AI LLM models on domain-specific enterprise tasks or complex evaluation rubrics.
- Background in setting up or managing cross-functional workflows across Support, CS, and Revenue Operations teams.
- Deep familiarity with REST APIs, webhooks, or technical integration troubleshooting in SaaS products.
Similar jobs
- ML
Senior QA Automation EngineerRecently posted
Masterapp Labs · Glen Allen, VA · On-site · Posted 16 Nov 2026 🇺🇸
JiraTechnologySalary not listed - TT
QA Tester (Selenium / LoadRunner / SQL)Recently posted
Trigyn Technologies, Inc. · Menands, NY · Hybrid · Posted 16 Nov 2026 🇺🇸
SQLSeleniumCypress+8TechnologySalary not listed - DK

QA Automation TesterRecently posted
DKMRBH Inc. · Richmond, VA · On-site · Posted 16 Nov 2026 🇺🇸
Case ManagementPlaywrightJiraTechnologySalary not listed - KB
DSS Software Tester/QA Analyst 3 (814402)Recently posted
Key Business Solutions, Inc. · Richmond, VA · On-site · Posted 16 Nov 2026 🇺🇸
JiraTechnologySalary not listed - AI

Software Tester/QA Analyst 3Recently posted
Asterism IT Solutions · Glen Allen, VA · On-site · Posted 16 Nov 2026 🇺🇸
JiraTechnologySalary not listed - SP

QA Automation & Manual Test AnalystRecently posted
Stellar Professionals LLC · Glen Allen, VA · On-site · Posted 16 Nov 2026 🇺🇸
Case ManagementPlaywrightJiraTechnologySalary not listed - HM

QA Lead with Retail domain and Data IntegrationRecently posted
Happiest Minds Technologies Limited · San Francisco, CA · On-site · Posted 16 Nov 2026 🇺🇸
SQLERPDatabricks+4TechnologySalary not listed - BM

Senior Test Engineer, Autonomous UAS Systems with Security ClearanceRecently posted
Battelle Memorial Institute · Columbus, OH · Hybrid · Posted 16 Nov 2026 🇺🇸
Data AnalysisTechnology$135k - $175k/yr - AC
Quality Assurance Analyst I RemoteRecently posted
Apetan Consulting · United States · Remote · Posted 16 Nov 2026 🇺🇸
Project ManagementTechnologySalary not listed - TT
Senior Quality Assurance EngineerRecently posted
Tandym Tech · New York, NY · On-site · Posted 16 Nov 2026 🇺🇸
SQLSeleniumCI/CDTechnologySalary not listed - SH
Staff Engineer, Flight Test (R6064) with Security ClearanceRecently posted
Shield · Arlington, VA · Hybrid · Posted 16 Nov 2026 🇺🇸
GitPythonAzure+4TechnologySalary not listed - DO

Supervisory Quality Assurance Specialist with Security Clearance
Department of Defense · Lynchburg, VA · Remote · Posted 2 Nov 2026 🇺🇸
TechnologySalary not listed