# Member of Technical Staff, Applied ML at True Talent Solutions Partners

- Company: True Talent Solutions Partners
- Status: Closed
- Workplace: On-site
- Location: New York
- Level: Staff
- Discipline: AI & ML
- Employment: Full-time
- Salary: $175K–350K
- Posted: 2026-11-18
- Skills: machine learning
- Apply: https://jobs.ashbyhq.com/true-talent-solutions-partners/f31dc5a8-e33e-4b98-ad56-c0da1aa683ab

## Description

ABOUT THE ROLE

Join an applied machine learning team building production AI agents for accounting and finance workflows. You will own projects from initial design and experimentation through deployment, helping make agent systems more capable, reliable, and measurable.


WHAT YOU'LL DO

 - Design and improve multi-agent architectures that automate complex accounting workflows.

 - Define agent autonomy boundaries, tool use, fallback behaviors, and measurable success criteria.

 - Build evaluation pipelines, golden tasks, metrics, and experiments to assess model and agent reliability.

 - Instrument systems to detect regressions, analyze errors, and support continuous improvement.

 - Route and optimize models against latency, cost, and accuracy constraints.

 - Develop prompt, context, memory, retrieval, and indexing systems that help agents reason across tasks.

 - Parse unstructured documents into useful structured representations and implement validation guardrails.

 - Scope projects, document technical decisions, and communicate progress and learnings to teammates.


WHAT WE'RE LOOKING FOR

 - Four to twelve years of machine learning engineering experience, including applied ML work in industry.

 - Experience delivering end-to-end LLM-based agent applications, including model orchestration, benchmarking, and evaluation of behavior and reliability.

 - Strong Python skills and deep familiarity with LLM and transformer-based systems; experience with Postgres is relevant.

 - Experience running structured ML experiments, building evaluation infrastructure, and iterating

More True Talent Solutions Partners roles: https://deviantjobs.com/companies/true-talent-solutions-partners
