# Full-Stack Engineer, Agent Evaluation & Reliability at True Talent Solutions Partners

- Company: True Talent Solutions Partners
- Status: Open
- Workplace: On-site
- Location: San Francisco
- Level: Mid-level
- Discipline: Full-stack
- Employment: Full-time
- Posted: 2026-11-09
- Skills: Client Roles
- Apply: https://jobs.ashbyhq.com/true-talent-solutions-partners/c72efdd6-5a70-4085-9eeb-385ae68c1b3e

## Description

ABOUT THE ROLE

Join an AI team building backend infrastructure for agent evaluation and continuous improvement. This backend-leaning full-stack role offers ownership of architecture and product decisions while turning complex systems into useful customer-facing features.


WHAT YOU'LL DO

 - Build and maintain backend systems that power agent evaluation and continuous improvement.

 - Design data models for evaluation datasets, experiment runs, agent traces, knowledge versions, findings, and customer-defined quality criteria.

 - Develop and support enterprise integrations, including authentication, OAuth, webhooks, incremental syncs, backfills, rate limits, retries, and monitoring.

 - Own features end to end, from technical design and implementation through deployment, observability, customer feedback, and iteration.

 - Work directly with customers to diagnose system failures and turn individual needs into reusable product capabilities.

 - Debug distributed workflows and improve system reliability.


WHAT WE'RE LOOKING FOR

 - Two to four years of experience in a full-stack or backend engineering role building and shipping production systems.

 - Production experience with TypeScript and Node.js or Bun, PostgreSQL schema design, and queues or worker systems.

 - Hands-on machine learning engineering experience, including model development, and familiarity with agent infrastructure, LLM evaluation, tracing, or agent memory systems.

 - Experience building backend systems and third-party integrations, and owning projects from design through deployment and iteration.

 - 

More True Talent Solutions Partners roles: https://deviantjobs.com/companies/true-talent-solutions-partners