# Research Scientist, Scaling RL at Periodic Labs

- Company: Periodic Labs
- Status: Open
- Workplace: On-site
- Location: Menlo Park, CA
- Level: Mid-level
- Discipline: AI & ML
- Employment: Full-time
- Posted: 2026-10-01
- Skills: Engineering
- Apply: https://jobs.ashbyhq.com/periodic-labs/20b122c9-b8ec-4fb0-aaf4-9b45902affe0

## Description

ABOUT PERIODIC LABS

We're an AI and physical sciences company building state-of-the-art models to accelerate breakthroughs across materials, energy, and beyond. Backed by world-class investors and growing rapidly, we operate at the pace the frontier requires. Our team brings deep expertise, genuine ownership, and a drive to push the boundaries of what's scientifically possible.




ABOUT THE ROLE

We're training frontier models to develop deep scientific knowledge and reasoning for scientific tasks. You’ll study how RL scales with training compute, develop better algorithms, and take ideas from controlled experiments to our largest runs like Periodic Neon https://periodic.com/news/nature-is-our-learning-environment.




WHAT YOU'LL DO

 - Design experiments to understand how RL performance scales with compute, model size, data, and reward quality, building on work such as ScaleRL https://arxiv.org/abs/2510.13786

 - Develop better RL algorithms, spanning policy optimization, advantage estimation, exploration, and credit assignment for long-horizon RL tasks

 - Build adaptive sampling and curriculum methods that adjust task difficulty, problem selection, and the number of rollouts as models improve

 - Study bias and stability during RL training, including importance-sampling corrections  and methods to tackle policy staleness and training–inference mismatch, as discussed here https://www.youtube.com/watch?v=GH4JCdAAUYg.

 - Improve compute efficiency across training and inference through experiments with hyperparameters, such as length penalties, rollout counts, batch size

More Periodic Labs roles: https://deviantjobs.com/companies/periodic-labs