WFH.teamOpen app$166k-$354k
Salary details are shown when available from the source listing. Sign in before applying so the role can be reviewed against your resume, salary goals, seniority, timezone, and location eligibility.
Decision details from the source listing
Not specified
Not specified
These fields are normalized from the employer's text. Confirm details on the employer site before applying.
What this posting tells you
Remote contractor role for an intelligence analyst supporting evaluation and improvement of AI systems. Work includes developing analytic test cases, assessing model responses for source use and rigor, identifying over-refusals, and documenting edge cases. No prior AI experience is required; all-source or specialized analytic expertise is preferred.
Education, Product
Eligible countries are not stated.
Timezone overlap is not stated.
Not specified · Contractor
- Eligible hiring countries are not stated
- Required timezone overlap is not stated
Education hiring on WFH.team
This role's listed pay is above the median among 200 comparable roles shown here. Category counts come from WFH.team's latest published remote job market snapshot.
Explore the remote job marketIntelligence Analyst at micro1
Role Title: Intelligence Analyst
Role Type: Contractor
Location: Remote
micro1 is engaging Intelligence Analysts to contribute to a customer-facing project focused on evaluating and advancing artificial intelligence capabilities. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
Develop and map analytic cases to defined taxonomies across multiple evaluation areas, ensuring comprehensive coverage of relevant intelligence scenarios.
Author complex test cases designed to evaluate model performance on source handling, analytic rigor, and nuanced uncertainty expression.
Assess and grade AI-generated responses based on criteria such as reasoning, source use, recognition of limitations, and practical utility.
Identify and flag instances where legitimate analytic exploration is over-refused by the model, providing clear documentation and feedback.
Document edge cases and analytic disagreements, supporting continuous improvement of evaluation methodologies.
Collaborate with project leads to refine procedures for source evaluation and confidence-level assignment.
Contribute insights to help calibrate analytic standards and enhance the overall quality of AI system benchmarks.
Preferred qualifications
Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline, ideally with a civilian-IC background.
Strong proficiency in source evaluation, confidence-level assessment, and established analytic standards.
Experience in teaching, mentoring, or leading analytic reviews, with a record of fostering analytic rigor.
Exceptional written and verbal communication skills, with a focus on clarity and precision.
Ability to identify and articulate nuanced model limitations and over-refusal scenarios.
Familiarity with structured analytic techniques and intelligence tradecraft standards.
Previous participation in AI evaluation or model assessment initiatives is a plus.
Learn More About Our Government & Defense Work
At micro1, we work with government and defense experts to evaluate how advanced AI models perform on real-world tasks.
Our MissionReport benchmark assesses AI-generated military and government reports, highlighting the importance of expert judgment, accuracy, and operational understanding.
Learn more: https://www.micro1.ai/benchmark/mission-report
Working remotely at micro1
micro1 builds human-expertise data and evaluation infrastructure for AI models and agents. It recruits core-team employees and domain experts for AI training projects.
- Headquarters
- San Francisco Bay Area, California, United States
- Founded
- 2022
Expert opportunities are remote and can be flexible. International applicants are considered, subject to country exclusions and each project's requirements. Core-team work arrangements vary by opening; check the individual posting.
Apply through the official posting. Expert applicants complete an AI interview and skills certification, followed by project selection and onboarding. Certification does not guarantee a project or immediate work.