WFH.teamOpen app
Back to remote jobs
Remote job detail

AI Product Evaluator

micro1

LocationUnited Kingdom, India, Japan
SeniorityUnspecified
Companymicro1
Recently checkedNov 14
Compensation

$29k-$75k

Salary details are shown when available from the source listing. Sign in before applying so the role can be reviewed against your resume, salary goals, seniority, timezone, and location eligibility.

Requirements and working style

Decision details from the source listing

Schedule

fixed

These fields are normalized from the employer's text. Confirm details on the employer site before applying.

WFH.team analysis

What this posting tells you

Contractor role evaluating AI models and agents against predefined scenarios and guidelines, documenting findings, and submitting evaluation datasets. Remote in India, Japan, or the United Kingdom. The listing mentions strict timeframes but does not specify a salary, experience duration, education, or benefits.

Role lane

Product, QA and testing, Software

Where you can work

United Kingdom, India, Japan

Working hours

Timezone overlap is not stated.

Arrangement

Unspecified · Contractor

Required signals
AI model and agent evaluationFollowing detailed instructionsAttention to detailStructured written reportingOperational thoroughness
Preferred signals
Experience with AI products, models, or agent evaluationDigital product experienceSoftware QAAI researchDaily use of AI
Confirm before applying
  • Required timezone overlap is not stated
Market context

Product hiring on WFH.team

14,233active related roles
4,026new in the latest period
725.8jobs per 100 candidates
$183kmedian of comparable listed ranges

This role's listed pay is below the median among 200 comparable roles shown here. Category counts come from WFH.team's latest published remote job market snapshot.

Explore the remote job market
Skills and signals
AI model and agent evaluationFollowing detailed instructionsAttention to detailStructured written reportingOperational thoroughnessExperience with AI products, models, or agent evaluationDigital product experienceSoftware QAAI researchDaily use of AIRemote
Job description

AI Product Evaluator at micro1

Role Title: AI Product Evaluator

Role Type: Contractor

Location: India, Japan or United Kingdom, Remote

micro1 is engaging expert AI Product Evaluators to contribute directly to a customer's high-impact AI project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. This operationally intensive engagement involves handling AI model and agent evaluations, often within strict timeframes and usage limit resets. The project benefits greatly from contributions of multiple specialists, each bringing a meticulous approach to instruction-following and quality assurance.

Scope of Work

Evaluate AI models and agents according to detailed, pre-defined scenarios and guidelines.

Execute a series of operational tasks designed to test model accuracy, reasoning, and responsiveness.

Document findings, observations, and any anomalies in structured written reports.

Reset usage limits and repeat evaluations as required by project protocols.

Record findings and submit evaluation datasets on AI training platforms in line with project standards and milestones.

Maintain a high standard of attention to detail and rigor across all evaluation tasks.

Preferred qualifications

Experience with AI products, AI models, or AI agent evaluation and testing.

Demonstrated ability to follow complex instructions with precision and consistency.

Exceptional attention to detail and operational thoroughness.

Someone who already uses AI in daily life.

Comfort working with repetitive or high-volume operational tasks within strict timeframes.

Prior participation in digital product, software QA, or AI research projects is a plus.

Detail-oriented, great at following instructions and documenting each step.

Company context

Working remotely at micro1

micro1 builds human-expertise data and evaluation infrastructure for AI models and agents. It recruits core-team employees and domain experts for AI training projects.

Headquarters
San Francisco Bay Area, California, United States
Founded
2022
Remote policy

Expert opportunities are remote and can be flexible. International applicants are considered, subject to country exclusions and each project's requirements. Core-team work arrangements vary by opening; check the individual posting.

Application process

Apply through the official posting. Expert applicants complete an AI interview and skills certification, followed by project selection and onboarding. Certification does not guarantee a project or immediate work.

Research micro1