# Research Engineer, Benchmarks at Clera

- Company: Clera
- Status: Open
- Workplace: On-site
- Location: Singapore
- Level: Mid-level
- Discipline: AI & ML
- Employment: Full-time
- Salary: $100K–170K
- Posted: 2026-11-18
- Skills: Engineering
- Apply: https://jobs.ashbyhq.com/Clera/1f19b698-f188-4172-93d5-f7cb5634d67f

## Description

ABOUT THE ROLE

Join a small, technical team building benchmarks to evaluate frontier AI agents on realistic, domain-specific workflows. You will own evaluation design and implementation, helping ensure benchmark results are rigorous, credible, and relevant to real-world performance.


WHAT YOU'LL DO

 - Design, implement, and maintain benchmarks for evaluating frontier agents on domain-specific tasks.

 - Work with subject-matter experts to translate real workflows into realistic tasks and evaluation criteria.

 - Build reliable infrastructure for running models and agents against benchmark tasks at scale.

 - Develop metrics and analyses to assess benchmark difficulty, reliability, and failure modes.

 - Validate whether benchmark results correlate with real-world evaluations and user needs.

 - Write clear documentation and reports for technical audiences.


WHAT WE'RE LOOKING FOR

 - Two or more years of experience in research engineering or machine learning engineering, building AI benchmarks, evaluation infrastructure, or agent environments.

 - Technical education or equivalent grounding, with strong first-principles reasoning about task design, scoring, and failure modes.

 - Proficiency in Python, Docker, and Linux, including experience operating infrastructure for AI models or agents.

 - Hands-on experience designing and running evaluations for AI agents or large language models, with relevant, focused experience in benchmarks or evaluation.

 - Experience developing metrics, statistical analyses, or validation studies, and translating workflows across domains in

More Clera roles: https://deviantjobs.com/companies/clera
