WFH.teamOpen app
Back to remote jobs
Remote job detail

Domain Contributor - Evaluation Specialist

micro1

LocationRemote
SenioritySpecialist
Companymicro1
Verified recentlyChecked today
Compensation

$62k-$125k

Salary details are shown when available from the source listing. Sign in before applying so the role can be reviewed against your resume, salary goals, seniority, timezone, and location eligibility.

Requirements and working style

Decision details from the source listing

Schedule

flexible

These fields are normalized from the employer's text. Confirm details on the employer site before applying.

WFH.team analysis

What this posting tells you

Remote contractor role, approximately 15 hours per week, creating domain-specific tasks and evaluating AI model outputs. Work is flexible and paid per qualifying task, with minimum weekly submission requirements. The listing gives no pay range.

Role lane

Accounting, Insurance claims, Customer success, Design and creative, Finance and investments, Legal, Product, Security, Customer support

Where you can work

Eligible countries are not stated.

Working hours

Timezone overlap is not stated.

Arrangement

Specialist · Contractor · Part-time (~15 hours/week)

Required signals
Deep expertise in a relevant domainAI model training, annotation, RLHF, or evaluation experienceAdvanced research and source verificationClear written and verbal communicationAbility to follow detailed instructions and evaluation frameworks
Preferred signals
Adversarial task designGraduate-level researchFortune 100 company experienceProfessional fluency in a non-English language
Confirm before applying
  • Eligible hiring countries are not stated
  • Required timezone overlap is not stated
Market context

Accounting hiring on WFH.team

2,453active related roles
1,062new in the latest period
1202.5jobs per 100 candidates
$174kmedian of comparable listed ranges

This role's listed pay is below the median among 200 comparable roles shown here. Category counts come from WFH.team's latest published remote job market snapshot.

Explore the remote job market
Skills and signals
Deep expertise in a relevant domainAI model training, annotation, RLHF, or evaluation experienceAdvanced research and source verificationClear written and verbal communicationAbility to follow detailed instructions and evaluation frameworksAdversarial task designGraduate-level researchFortune 100 company experienceProfessional fluency in a non-English languageRemote
Job description

Domain Contributor - Evaluation Specialist at micro1

Role Title: Domain Contributor - Evaluation Specialist

Role Type: Contractor (~15 hrs/week)

Location: Remote

micro1 is engaging Domain Contributor - Evaluation Specialists to support an internal project evaluating and improving advanced AI models. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Flexible, pay-per-task work across history, law, finance, journalism, and tech, for experts with prior AI training experience.

Scope of Work

Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.

Author questions and scenarios demanding deep subject knowledge, beyond general understanding.

Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.

Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.

Apply detailed task guidelines and evaluation rubrics consistently to each submission.

Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.

Preferred qualifications

Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.

Deep expertise in a core domain: history, archival or library science, law (paralegal, legal academic, compliance), finance (equity research, PE/VC, forensic accounting), journalism, or technology/industry history.

Advanced research skills with a track record of verifying complex claims against authoritative sources.

Exceptional written and verbal communication skills to articulate findings and feedback.

Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.

Background in adversarial or “stomp the model” task design is advantageous.

Graduate-level research, experience at a Fortune 100 company, or professional fluency in a non-English language a plus.

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

Company context

Working remotely at micro1

micro1 builds human-expertise data and evaluation infrastructure for AI models and agents. It recruits core-team employees and domain experts for AI training projects.

Headquarters
San Francisco Bay Area, California, United States
Founded
2022
Remote policy

Expert opportunities are remote and can be flexible. International applicants are considered, subject to country exclusions and each project's requirements. Core-team work arrangements vary by opening; check the individual posting.

Application process

Apply through the official posting. Expert applicants complete an AI interview and skills certification, followed by project selection and onboarding. Certification does not guarantee a project or immediate work.

Research micro1