Quick Overview
Job Description
This role is for one of our clients
Compensation: $80-$150 per hour
1. Role Overview
We are seeking experienced UI/UX and product design professionals to contribute to an AI research initiative focused on evaluating how effectively AI systems perform real-world digital product design work. In this role, you will help define what high-quality product and UX work looks like by developing task-specific evaluation criteria and assessing completed work samples with rigorous, well-reasoned written feedback.
The ideal candidate brings hands-on experience designing digital products, strong knowledge of modern UX practices, and the ability to distinguish thoughtful, production-ready design from superficial or incomplete work.
2. Key Responsibilities
- Develop clear, objective, task-specific grading criteria for digital product and UX deliverables, including:
- Design systems and component libraries
- Responsive interfaces, dashboards, and web applications
- End-to-end product journeys such as onboarding, checkout, booking, and account management
- Customer portals and logged-in experiences
- UX writing and product content
- Design-to-development and production handoff
- Evaluate AI-generated and human-created design work against established criteria.
- Provide detailed, evidence-based written explanations for each evaluation, clearly identifying strengths, weaknesses, usability issues, and areas for improvement.
- Apply consistent standards so that evaluations are objective, reproducible, and aligned with real-world product expectations.
- Incorporate feedback from senior reviewers and continuously refine evaluation approaches.
- Assess designs from the perspective of usability, accessibility, visual quality, interaction patterns, business objectives, and end-user needs.
3. Ideal Qualifications
- 5+ years of professional experience in product design, UI/UX, UX design, or design systems for real-world digital products.
- Experience working with leading digital-product or UX studios, product-led organizations, e-commerce platforms, marketplaces, or technology companies with sophisticated digital experiences.
- Relevant experience in one or more areas such as:
- Product / UI Designer
- UX Designer or UX Lead
- Design Systems Designer
- UX Writer / Content Designer
- Digital Product or Business Analyst
- Strong command of interaction design, visual design, responsive layouts, design systems, prototyping, usability principles, and end-to-end product flows.
- Hands-on proficiency with Figma and familiarity with production and engineering handoff processes.
- Ability to critically evaluate design decisions and articulate feedback at the level expected from a senior design or UX lead.
- Excellent written communication skills, with the ability to clearly explain why a design does or does not meet professional standards.
- Strong attention to detail and the ability to apply consistent evaluation criteria across different design solutions.
- Comfortable receiving feedback and having professional judgment reviewed and calibrated against other experts.
- Prior experience with AI training, AI evaluation, or human-data projects is a plus.
4. Application Process
- Submit your resume, portfolio, or relevant professional background.
- Qualified candidates may be asked to complete a brief design assessment or provide additional information about their experience.
- Selected professionals will receive further details about the project, evaluation process, and onboarding requirements.
5. Work Arrangement
- Fully remote engagement
- Flexible project-based schedule
- Work focused on digital product, UI/UX, and design evaluation
- Collaboration with an experienced research and review team
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
6. Contract and Payment Terms
- Engagement is structured as an independent contractor opportunity.
- Work can be completed remotely and generally on a flexible schedule.
- Projects may be extended, shortened, or concluded based on project requirements and performance.
- Work will not require access to confidential or proprietary information belonging to any current or former employer, client, or institution.
- Payments are made weekly through supported payment platforms based on services rendered.
- Candidates must meet all applicable eligibility requirements for the engagement.
Similar jobs
- VA
UX Designer Sr
NewAuto ApplyValtech
United States - Remote🇺🇸Remote23 hours agoFigmaAgileContent Strategy+2Marketing - AF
UX Designer with 508 Compliance
NewAuto ApplyAccenture Federal Services
Arlington🇺🇸$64k - $124.2k/yrHybridYesterdayFigmaInVisionSketch+4Marketing - SI
Senior User Experience Design Specialist (Multiple Positions Available)
NewAuto ApplySAP IT Business Systeme
Palo Alto, CA🇺🇸$170.3k - $244.5k/yrHybridYesterdayFigmaMarketing - WO
UX Designer at Workbrew
NewAuto ApplyWorkbrew
United States🇺🇸RemoteYesterdaySQLFigmaCompliance+3Marketing - TO
Lead Product & UX Designer
Auto ApplyThink of Us
Hybrid🇺🇸$150k - $180k/yrHybrid6 weeks agoSketchCase ManagementMental HealthMarketing - CO
User Experience Designer
Auto ApplyCollabera
San Diego, CA🇺🇸On-site9 years agoInVisionScrumSketch+5Marketing - CO
Contract to Hire :: Jr. UX Designer
Auto ApplyCollabera
Van Buren Charter Township, MI🇺🇸On-site10 years agoInVisionSketchCornerstone+2Marketing - CO
Contract to hire :: Senior UX Designer
Auto ApplyCollabera
Van Buren Charter Township, MI🇺🇸On-site10 years agoInVisionSketchCornerstone+2Marketing - CO
UX Designer
Auto ApplyCollabera
Southfield, MI🇺🇸On-site10 years agoPhotoshopIllustratorMarketing - CO
UX Designer
Auto ApplyCollabera
Philadelphia, PA🇺🇸On-site10 years agoAgileMarketing - CO
UX Designer
Auto ApplyCollabera
Bingham Farms, MI🇺🇸On-site10 years agoAgileD3.jsMarketing - CO
User Experience Designer
Auto ApplyCollabera
Irving, TX🇺🇸On-site10 years agoCSSC++HTML+5Marketing