Job description

This role is for one of our clients Compensation: $80-$150 per hour 1. Role Overview We are seeking experienced UI/UX and product design professionals to contribute to an AI research initiative focused on evaluating how effectively AI systems perform real-world digital product design work. In this role, you will help define what high-quality product and UX work looks like by developing task-specific evaluation criteria and assessing completed work samples with rigorous, well-reasoned written feedback. The ideal candidate brings hands-on experience designing digital products, strong knowledge of modern UX practices, and the ability to distinguish thoughtful, production-ready design from superficial or incomplete work. 2. Key Responsibilities • Develop clear, objective, task-specific grading criteria for digital product and UX deliverables, including: • Design systems and component libraries • Responsive interfaces, dashboards, and web applications • End-to-end product journeys such as onboarding, checkout, booking, and account management • Customer portals and logged-in experiences • UX writing and product content • Design-to-development and production handoff • • Evaluate AI-generated and human-created design work against established criteria. • Provide detailed, evidence-based written explanations for each evaluation, clearly identifying strengths, weaknesses, usability issues, and areas for improvement. • Apply consistent standards so that evaluations are objective, reproducible, and aligned with real-world product expectations. • Incorporate feedback from senior reviewers and continuously refine evaluation approaches. • Assess designs from the perspective of usability, accessibility, visual quality, interaction patterns, business objectives, and end-user needs. 3. Ideal Qualifications • 5+ years of professional experience in product design, UI/UX, UX design, or design systems for real-world digital products. • Experience working with leading digital-product or UX studios, product-led organizations, e-commerce platforms, marketplaces, or technology companies with sophisticated digital experiences. • Relevant experience in one or more areas such as: • Product / UI Designer • UX Designer or UX Lead • Design Systems Designer • UX Writer / Content Designer • Digital Product or Business Analyst • • Strong command of interaction design, visual design, responsive layouts, design systems, prototyping, usability principles, and end-to-end product flows. • Hands-on proficiency with Figma and familiarity with production and engineering handoff processes. • Ability to critically evaluate design decisions and articulate feedback at the level expected from a senior design or UX lead. • Excellent written communication skills, with the ability to clearly explain why a design does or does not meet professional standards. • Strong attention to detail and the ability to apply consistent evaluation criteria across different design solutions. • Comfortable receiving feedback and having professional judgment reviewed and calibrated against other experts. • Prior experience with AI training, AI evaluation, or human-data projects is a plus. 4. Application Process • Submit your resume, portfolio, or relevant professional background. • Qualified candidates may be asked to complete a brief design assessment or provide additional information about their experience. • Selected professionals will receive further details about the project, evaluation process, and onboarding requirements. 5. Work Arrangement • Fully remote engagement • Flexible project-based schedule • Work focused on digital product, UI/UX, and design evaluation • Collaboration with an experienced research and review team We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request. 6. Contract and Payment Terms • Engagement is structured as an independent contractor opportunity. • Work can be completed remotely and generally on a flexible schedule. • Projects may be extended, shortened, or concluded based on project requirements and performance. • Work will not require access to confidential or proprietary information belonging to any current or former employer, client, or institution. • Payments are made weekly through supported payment platforms based on services rendered. • Candidates must meet all applicable eligibility requirements for the engagement.

Requirements

Must-haves

This role is for one of our clients
Compensation: $80-$150 per hour
The ideal candidate brings hands-on experience designing digital products, strong knowledge of modern UX practices, and the ability to distinguish thoughtful, production-ready design from superficial or incomplete work.
Develop clear, objective, task-specific grading criteria for digital product and UX deliverables, including:
Design systems and component libraries
Responsive interfaces, dashboards, and web applications
End-to-end product journeys such as onboarding, checkout, booking, and account management
Customer portals and logged-in experiences
UX writing and product content
Design-to-development and production handoff
Evaluate AI-generated and human-created design work against established criteria.
Provide detailed, evidence-based written explanations for each evaluation, clearly identifying strengths, weaknesses, usability issues, and areas for improvement.
Apply consistent standards so that evaluations are objective, reproducible, and aligned with real-world product expectations.
Incorporate feedback from senior reviewers and continuously refine evaluation approaches.
Assess designs from the perspective of usability, accessibility, visual quality, interaction patterns, business objectives, and end-user needs.
Ideal Qualifications
5+ years of professional experience in product design, UI/UX, UX design, or design systems for real-world digital products.
Experience working with leading digital-product or UX studios, product-led organizations, e-commerce platforms, marketplaces, or technology companies with sophisticated digital experiences.
Relevant experience in one or more areas such as:
Product / UI Designer
UX Designer or UX Lead
Design Systems Designer
UX Writer / Content Designer

Nice-to-haves

Prior experience with AI training, AI evaluation, or human-data projects is a plus.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aidesign systemsaccessibilityfigma

Platform: workable
Effort: medium