Secretary & Admin Assistant

Role Title: Secretary & Admin Assistant

Role Type: Contractor

Location: Remote

The company is engaging Secretary & Admin Assistants to contribute to a customer's project focused on designing and producing expert-authored evaluation tasks for a frontier AI benchmark. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. This engagement offers the opportunity to simulate authentic administrative challenges, crafting assignments that reflect the complexity and nuance of real-world operations, and directly impact the advancement of intelligent systems.

Scope of Work

1. Design realistic, process-driven evaluation tasks that require sophisticated multi-tool coordination (e.g., calendar reconciliation, travel and expense workflows, records management, professional correspondence).
2. Create and assemble authentic data artifacts, including emails, calendar entries, receipts, meeting notes, and contact records, to support each evaluation scenario.
3. Define correct solutions and map out the step-by-step decisions an expert would take to achieve the best outcome in each scenario.
4. Develop comprehensive rubrics (35+ criteria) that assess both process adherence and nuanced judgment calls for AI agent outputs.
5. Document workflow processes and suggest improvements that reflect current best practices in the administrative domain.
6. Collaborate with project leads to calibrate task complexity and ensure alignment with real-world challenges faced by experienced professionals.

Preferred Qualifications

1. 5+ years of experience supporting teams or departments within mid-to-large organizations in a professional administrative capacity.
2. Demonstrated process ownership and responsibility for ongoing, recurring workflows beyond ad-hoc assignments.
3. Expertise in documenting, evaluating, and improving inherited administrative procedures.
4. Proficient written and verbal communication skills with a strong command of professional correspondence standards.
5. Exceptional attention to detail, ensuring accuracy in both content creation and process documentation.
6. Comfort working with a variety of digital tools, platforms, and data formats (CSVs, PDFs, spreadsheets, technical documents).
7. Enthusiasm for shaping the future of intelligent systems by sharing domain-specific knowledge and best practices.

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.