# Member of Technical Staff at True Talent Solutions Partners

- Company: True Talent Solutions Partners
- Status: Open
- Workplace: On-site
- Location: San Francisco
- Level: Staff
- Discipline: AI & ML
- Employment: Full-time
- Posted: 2026-11-01
- Skills: AI, Python
- Apply: https://jobs.ashbyhq.com/true-talent-solutions-partners/5722e68b-e91b-4774-b85c-fc562a954c54

## Description

ABOUT THE ROLE

Join a small AI infrastructure team building efficient inference systems for open-source language models. You will improve performance across diverse hardware, helping make production AI serving faster and more cost-effective.


WHAT YOU'LL DO

 - Bring new open-source models into production with tuning for latency and throughput.

 - Optimize inference serving, including batching, KV caching, speculative decoding, and quantization.

 - Write and tune GPU kernels using CUDA, HIP, and Triton across varied accelerator platforms.

 - Design, deploy, and operate heterogeneous compute clusters across infrastructure vendors.

 - Run production inference systems, improving reliability, observability, and cost efficiency.

 - Work with customers to understand needs and help solve infrastructure challenges.


WHAT WE'RE LOOKING FOR

 - Typically 1 to 6 years of experience, with relevant early-career candidates also considered.

 - Strong systems or infrastructure engineering experience, in addition to any application or full-stack work.

 - Understanding of computer architecture, memory hierarchy, and operating system internals.

 - Experience with Python and familiarity with CUDA, HIP, Triton, or other GPU programming tools.

 - Knowledge of inference optimization techniques such as quantization, batching, KV caching, or speculative decoding.

 - Experience deploying or operating infrastructure at scale, such as clusters or large GPU fleets, is valuable.

 - Evidence of taking on challenging systems problems, learning quickly, and using AI coding tools to improve wo

More True Talent Solutions Partners roles: https://deviantjobs.com/companies/true-talent-solutions-partners