Customer Support, Success & Billing Ops Domain Expert (QA & Evaluation)
Quick overview
Job description
(JD) - Customer Support, Success & Billing Ops Domain Expert (QA & Evaluation)
Role Overview
We are seeking experienced B2B SaaS Customer Support, Customer Success, and Billing Operations practitioners to evaluate complex enterprise AI tasks, workflow resolution quality, and grading rubrics. As a hands-on Domain Expert, you will act as a senior evaluator reviewing real-world SaaS operational scenarios, ensuring task realism, policy compliance, and rigorous quality standards across multi-application SaaS ecosystems.
Qualifications & Core Experience
Years of Experience: 5+ years of direct, hands-on post-sales operational experience in a B2B SaaS environment.
Role Background: Proven background in one of the following specialized sub-roles:
Tier 2/3 Technical Support Engineer owning end-to-end ticketing, triage, bug reproduction, and engineering escalations.
Senior Enterprise CSM managing accounts, renewals, QBRs, churn mitigation, and executive sponsor relationships.
CS Ops / Health & Adoption Lead running customer health scoring, retention modeling, and product utilization reporting.
Subscription Billing Support Lead managing invoice disputes, dunning, failed payments, and refund policies in Stripe or equivalent systems.
Education & Credentials: Bachelor's degree in Business, Information Systems, Computer Science, or equivalent practical industry experience.
Mandatory Technical & Operational Skills
SaaS Stack Fluency: Daily operational proficiency with tools such as Intercom, Zendesk, Salesforce, HubSpot, Stripe (or Chargebee/Zuora), Metabase/Looker/Gainsight, Slack, Notion, and Google Workspace / Microsoft Office.
Multi-System QA & Audit Acumen: Demonstrated ability to audit multi-step enterprise workflows by cross-referencing and reconciling conflicting data across 3+ business platforms simultaneously.
Policy & Restraint Guardrails: Strong capability to audit grading rubrics to flag unauthorized refunds, credits, contract repricings, data/ACL leaks, or unapproved external communications.
Scenario & Prompt Validation: Ability to craft and validate authentic, non-synthetic task scenarios and prompt evaluations that reflect realistic enterprise SaaS challenges.
Preferred Qualifications
Experience evaluating or training AI LLM models on domain-specific enterprise tasks or complex evaluation rubrics.
Background in setting up or managing cross-functional workflows across Support, CS, and Revenue Operations teams.
Deep familiarity with REST APIs, webhooks, or technical integration troubleshooting in SaaS products
Similar jobs
- CO
Software Tester / QA AnalystRecently posted
COOLSOFT · Richmond, VA · Hybrid · Posted 13 Nov 2026 🇺🇸
PlaywrightJiraTechnologySalary not listed - AC
Software Tester/QA Analyst 3Recently posted
Aita Consulting Services,Inc. · Glen Allen, VA · Hybrid · Posted 13 Nov 2026 🇺🇸
JiraTechnologySalary not listed - ES
Sr QA Manual TesterRecently posted
eSolutionsFirst, LLC · Southfield, MI · On-site · Posted 13 Nov 2026 🇺🇸
SQLScrumArticulate+2Salary not listed - SY
Mid-Level Test Automation Engineer [$246k/yr+] TS/SCI-FS Poly with Security ClearanceRecently posted
SYSTOLIC · Bethesda, MD · Hybrid · Posted 13 Nov 2026 🇺🇸
GitAWSScrum+9Technology$246k/yr - SY
Junior Test Automation Engineer [$194k/yr+] TS/SCI-FS Poly with Security ClearanceRecently posted
SYSTOLIC · Bethesda, MD · Hybrid · Posted 13 Nov 2026 🇺🇸
GitAWSSelenium+6Technology$194k/yr - ST
QA LeadRecently posted
StarTechs Inc. · Katy, TX · On-site · Posted 12 Nov 2026 🇺🇸
MicroservicesAWSSelenium+5TechnologySalary not listed - GF
SDET - W2 (No C2C or 1099) - Onsite role in Fremont, CA (Onsite interview required)Recently posted
Global Force USA · Fremont, CA · Hybrid · Posted 12 Nov 2026 🇺🇸
SQLSeleniumPlaywright+1TechnologySalary not listed - WI

Software Tester / QA AnalystRecently posted
WiserHunt Inc. · Glen Allen, VA · On-site · Posted 13 Nov 2026 🇺🇸
JiraTechnologySalary not listed - IF
Module Development Engineer - RF Test with Security ClearanceRecently posted
Intel Federal · Phoenix, AZ · On-site · Posted 9 Nov 2026 🇺🇸
Engineering$115.1k - $219.6k/yr - CE
Senior Software Quality Assurance Engineer Tester (INSCOM) with Security ClearanceRecently posted
CELESTAR CORPORATION · Gordon, GA · On-site · Posted 13 Nov 2026 🇺🇸
DockerAWSPython+3Technology$115k - $190k/yr - CE
Quality Assurance Tester with Security ClearanceRecently posted
CELESTAR CORPORATION · Ashburn, VA · Hybrid · Posted 13 Nov 2026 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft PowerPoint+3Technology$150k/yr - AS

Senior Test AnalystRecently posted
Amtex Systems Inc. · Milton, GA · On-site · Posted 13 Nov 2026 🇺🇸
TriageTechnologySalary not listed