Quick Overview
Job Description
We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface - email, storage, CRM, project management, social media management, web analytics, AEO/SEO, ads, CMS, product analytics and support - populated with realistic documents, dashboards, personas and deliberately planted problems.
You will help design and pressure-test the Creator and Influencer environments: the briefs, the artifacts, the judgment calls a strong practitioner would make, and the errors a weaker one would miss.
What you will do- Design task briefs drawn from work you have actually done running creator programs, including what the task is really testing - the planted issue and the decision a strong practitioner should reach
- Specify the documents, dashboards, personas and tool states a realistic version of that task requires
- Write or review the reference answer and the criteria that separate a strong response from a plausible-but-wrong one
- Review AI agent attempts and judge them against your own standard
Tasks span the capabilities we measure: diagnosing what happened from messy or conflicting data, prioritizing and making tradeoffs, planning and executing, QA and reconciliation, triage and escalation, research and evaluation, reporting, and orchestrating multi-step work across several tools.
Creator & Influencer scopeCreator discovery and evaluation, influencer program decisions, seeding and campaign execution, usage rights and disclosure judgment, and share-of-voice contribution.
Who we are looking for- Hands-on practitioner experience running creator or influencer programs - you have selected, negotiated with and measured creators yourself
- Comfortable with creator platforms, paid amplification through creator handles, and the disclosure rules that govern the work
- Prior experience building AI training environments, RL environments or simulated case studies is strongly preferred
- Rubric Academy or Rubric Bootcamp certification is strongly preferred
- Clear written reasoning - much of the value is in explaining why a decision is right
Applicants complete a short multiple-choice knowledge screener specific to this sub-domain before review.
Similar jobs
- X1
Senior Product Designer - End-to-End UX Lead (Fintech)
NewX15ventures
Melbourne, Victoria🇦🇺Hybrid1 hour agoMarketing - SR
General Manager eCommerce & Marketing - Supercheap Auto
NewSuper Retail Group
Brisbane, Queensland🇦🇺Hybrid1 hour agoBrand StrategyMarketing - DI
Paid Media and AI Strategist
NewDigital
Melbourne, Victoria🇦🇺Hybrid2 hours agoBrand StrategyGA4Google Ads+2Marketing - ME
Social Media Expert - AI Environments
NewMercor
Sydney🇦🇺Hybrid2 hours agoSEOSprout SocialMarketing - DI
Remote Freelance Paid Media & AI Strategist
NewDigital
Melbourne, Victoria🇦🇺Remote2 hours agoGoogle AdsGrowth MarketingMeta AdsMarketing - X1
Senior Product Designer
NewX15ventures
Melbourne, Victoria🇦🇺Hybrid2 hours agoProcurementMarketing - BC
Digital Experience Designer
NewBayside City Council
Victoria🇦🇺A$105.9k - A$115.6k/yrHybrid2 hours agoSalesforceCRMMarketing - X1
Senior Product Designer - End-to-End UX Lead (Fintech)
NewX15ventures
Sydney🇦🇺Hybrid2 hours agoMarketing - X1
Senior Product Designer
NewX15ventures
Sydney🇦🇺Hybrid2 hours agoProcurementMarketing - BJ
Product Designer (UI/UX) (Australia)
NewBjak
New South Wales🇦🇺Hybrid2 hours agoFigmaMarketing - SG
Senior UI/UX Designer
NewSimpro Group
Queensland🇦🇺Hybrid17 hours agoSASSFigmaCSS+4Marketing - PS
Strategic B2B SEO/AEO Lead - Remote
NewPinoy SEO
Australia🇦🇺Remote17 hours agoSEOProduct MarketingMarketing