# Full-Stack Engineer, Agent Evaluation & Reliability at True Talent Solutions Partners

- Company: True Talent Solutions Partners
- Status: Open
- Workplace: On-site
- Location: San Francisco
- Level: Mid-level
- Discipline: Full-stack
- Employment: Full-time
- Posted: 2026-11-01
- Skills: AI, React
- Apply: https://jobs.ashbyhq.com/true-talent-solutions-partners/782e807e-e209-4188-81dd-70e72e1334b7

## Description

ABOUT THE ROLE

Join a small, technical AI company building infrastructure that helps enterprise AI agents improve through production feedback. This backend-leaning full-stack role focuses on reliable evaluation systems and includes ownership of product features from design through delivery.


WHAT YOU'LL DO

 - Build backend systems for agent evaluation and continuous improvement.

 - Design data models for evaluation datasets, experiment runs, agent traces, knowledge versions, findings, and customer-defined quality criteria.

 - Develop and operate enterprise integrations, including authentication, OAuth, webhooks, incremental syncs, backfills, rate limits, retries, and monitoring.

 - Take features from technical design through implementation, deployment, monitoring, customer feedback, and iteration.

 - Work with customers to diagnose system failures and turn specific needs into reusable product capabilities.

 - Build product interfaces across the full stack while contributing to architecture and product decisions.


WHAT WE'RE LOOKING FOR

 - Two to four years of experience building and operating production software, including experience at a fast-paced startup.

 - Hands-on machine learning engineering experience that includes model development.

 - Strong production experience with TypeScript and Node.js or Bun, and the ability to work across the full stack.

 - Strong PostgreSQL knowledge and practical experience with Redis, job queues, background workers, or workflow systems.

 - Understanding of why evaluating nondeterministic AI agent systems differs from conven

More True Talent Solutions Partners roles: https://deviantjobs.com/companies/true-talent-solutions-partners