Science & Research
Domain Contributor - Evaluation Specialist
- Posted
- Location
- Global
- Openings
- 20
Role Title: Domain Contributor - Evaluation Specialist
Role Type: Contractor (~15 hrs/week)
Location: Remote
The company is engaging Domain Contributor - Evaluation Specialists to support an internal project evaluating and improving advanced AI models. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Flexible, pay-per-task work across history, law, finance, journalism, and tech, for experts with prior AI training experience.
Scope of Work
- Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.
- Author questions and scenarios demanding deep subject knowledge, beyond general understanding.
- Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.
- Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.
- Apply detailed task guidelines and evaluation rubrics consistently to each submission.
- Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.
Preferred Qualifications
- Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.
- Deep expertise in a core domain: history, archival or library science, law (paralegal, legal academic, compliance), finance (equity research, PE/VC, forensic accounting), journalism, or technology/industry history.
- Advanced research skills with a track record of verifying complex claims against authoritative sources.
- Exceptional written and verbal communication skills to articulate findings and feedback.
- Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.
- Background in adversarial or “stomp the model” task design is advantageous.
- Graduate-level research, experience at a Fortune 100 company, or professional fluency in a non-English language a plus.
Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.
Start Timeline & Availability
We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.
Skills
- Domain depth
- Source verification
- Reasoning clarity
- Evaluation expertise
This role at a glance
At $30–$60/hr, the Domain Contributor - Evaluation Specialist role comes to about $2,600–$5,200 a month for 20 hours a week, or $5,200–$10,400 a month full time — roughly $62,000–$125,000 over a full year. These are estimates before tax; contract roles are paid for the hours you work. It was posted 5 days ago. Science & Research roles listed on RemoteJobsOne have stayed open a median of 60 days before closing, counted over the 31 that have closed so far.
20 hours a week
$2,600–$5,200
a month, before tax
Full time
$5,200–$10,400
a month at 40 hours a week
A full year
$62,000–$125,000
full time, 52 weeks
Open for
5 days
Science & Research roles here close after about 60 days, counted over 31 that have closed. Apply while it is open.
How this pay compares
This role pays $30–$60/hr. Across the 20 hourly science & research roles open on RemoteJobsOne right now, the median runs from $60 to $120 an hour, and published rates range from $30 to $400. Its top rate of $60 sits within the category's median range.
This role
$30–$60/hr
Science & Research median
$60–$120/hr · full spread $30 to $400
Questions about this role
How much does the Domain Contributor - Evaluation Specialist role pay?
It pays $30–$60/hr, which is about $5,200–$10,400 a month full time before tax. The rate is set by the employer and shown exactly as published.
Compare pay across remote rolesIs this Domain Contributor - Evaluation Specialist job fully remote?
Yes. It is listed as a fully remote role, with the posting naming Global. You work from home, on your own equipment.
Is it full-time, part-time or contract work?
It is a contract role: you are paid for the hours you work, and you choose how many to take on within what the employer needs.
How remote contract work worksWhat skills does the Domain Contributor - Evaluation Specialist role ask for?
The posting asks for Domain depth, Source verification, Reasoning clarity and Evaluation expertise. Naming them clearly in your application helps.
How do I apply for Domain Contributor - Evaluation Specialist?
Press Apply on this page and enter your name and email. We email you your personal application link straight away, and you can continue at once to the employer's hiring platform to finish. Most roles there ask for a short AI interview afterwards — voice or video, in your browser. Then watch your email: the next steps arrive there.
How to prepare for the AI interview
Before you apply
Something wrong with this listing? Report it