# Full-Stack Engineer, Agent Evaluation & Reliability at True Talent Solutions Partners

- Company: True Talent Solutions Partners
- Status: Open
- Workplace: On-site
- Location: San Francisco
- Level: Mid-level
- Discipline: Full-stack
- Employment: Full-time
- Salary: $120K–180K
- Posted: 2026-11-15
- Skills: JavaScript, AI, Cloud
- Apply: https://jobs.ashbyhq.com/true-talent-solutions-partners/26e3c182-05a1-406e-a09a-3de7ec8191b8

## Description

ABOUT THE ROLE

Join an AI team building infrastructure for agent evaluation and continuous improvement. This backend-leaning full-stack role combines ownership of core systems with the opportunity to ship product features and work directly with enterprise customers.


WHAT YOU'LL DO

 - Build backend systems and data models for evaluation datasets, experiment runs, agent traces, knowledge versions, findings, and customer-defined quality criteria.

 - Develop and support enterprise integrations, including authentication, OAuth, webhooks, incremental syncs, backfills, rate limits, retries, and monitoring.

 - Own features from technical design and implementation through deployment, monitoring, customer feedback, and iteration.

 - Work with customers to understand their systems, diagnose issues, and turn specific needs into reusable product capabilities.

 - Contribute across the stack, building product experiences that make underlying systems useful.


WHAT WE'RE LOOKING FOR

 - At least 2 years of experience building and shipping production systems as a backend or full-stack engineer.

 - Production experience with TypeScript and Node.js or Bun, PostgreSQL, and job queues or worker systems.

 - Experience at a fast-paced startup, and a track record of owning projects end-to-end from design through deployment and iteration.

 - Hands-on machine learning engineering experience, including model development.

 - Experience building enterprise integrations, including OAuth flows, webhooks, incremental syncs, backfills, and rate-limit handling.

 - Production experience with age

More True Talent Solutions Partners roles: https://deviantjobs.com/companies/true-talent-solutions-partners
