# Senior Software Engineer, Model Evaluation at Clera

- Company: Clera
- Status: Open
- Workplace: Remote
- Location: remote
- Level: Senior
- Discipline: AI & ML
- Employment: Full-time
- Salary: $180K–250K
- Posted: 2026-11-20
- Skills: AI, model evaluation
- Apply: https://jobs.ashbyhq.com/Clera/1a188d33-e537-488e-b587-96eed8aac5e1

## Description

ABOUT THE ROLE

Join an early-stage AI company building agents for manufacturing and supply chain operations. In this research-focused engineering role, you will work with procurement and manufacturing experts to create benchmarks, train models, and improve agents used in real operational workflows.


WHAT YOU'LL DO

 - Design benchmarks and evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.

 - Work with domain experts to scope tasks, write reference answers and rubrics, and build graders.

 - Train and fine-tune models hands-on, using evaluation results to guide experiments.

 - Identify agent failures, develop improvements, and validate those improvements with measured results.

 - Help establish research and evaluation practices as an early member of the team.


WHAT WE'RE LOOKING FOR

 - At least 3 years of experience, with senior- or staff-level capability.

 - Experience designing and writing benchmarks or evaluations.

 - Experience authoring tasks, including defining scope, creating reference solutions or rubrics, and checking task quality.

 - Hands-on experience training and fine-tuning models, beyond using models through APIs.

 - Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.

 - Supply chain, procurement, manufacturing, or early-stage startup experience is a plus.


COMPENSATION & BENEFITS

Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship policy was not provided.


LOCATION

Fully remote in the United Stat

More Clera roles: https://deviantjobs.com/companies/clera
