# Machine Learning Infrastructure Engineer at True Talent Solutions Partners

- Company: True Talent Solutions Partners
- Status: Open
- Workplace: On-site
- Location: San Francisco
- Level: Mid-level
- Discipline: AI & ML
- Employment: Full-time
- Salary: $200K–400K
- Posted: 2026-11-19
- Skills: Client Roles
- Apply: https://jobs.ashbyhq.com/true-talent-solutions-partners/f235b6f4-41d9-4cb3-a5b1-7f4479b6def4

## Description

ABOUT THE ROLE

Join an AI team building large physics foundation models to predict real-world systems and identify effective actions. You will develop the distributed infrastructure that supports model training and inference, with weather data as a key application area.


WHAT YOU'LL DO

 - Design, deploy, and maintain distributed machine learning training and inference clusters.

 - Build scalable end-to-end pipelines for petabyte-scale datasets and model training across the ML lifecycle.

 - Evaluate training approaches, including parallelization methods and numerical precision trade-offs across model sizes.

 - Profile and debug low-level GPU operations to improve performance.

 - Track relevant research and apply promising ideas to infrastructure and workflows.


WHAT WE'RE LOOKING FOR

 - Two to ten years of experience building large-scale infrastructure for pretrained or foundation models, including compute clusters, data infrastructure, inference, and distributed training.

 - Hands-on experience optimizing large-scale training, data, or inference workloads, and using distributed training frameworks such as FSDP or DeepSpeed.

 - Experience with low-level GPU performance analysis and debugging, including CUDA and JAX.

 - Familiarity with Python, C++, Linux, NVIDIA GPUs, cloud platforms such as GCP, AWS, or Azure, and containerization and orchestration tools such as Docker and Kubernetes.

 - Background in physical AI or AI for science, such as robotics, autonomous systems, or biology, and motivation to work on scientific or physical-world applications.

 - Comfort 

More True Talent Solutions Partners roles: https://deviantjobs.com/companies/true-talent-solutions-partners
