# Web Crawling - Research Engineer at Thinking Machines - Company: Thinking Machines - Status: Open - Workplace: Hybrid - Location: San Francisco ยท Remote - Level: Mid-level - Discipline: AI & ML - Employment: Full-time - Posted: 2026-09-24 - Skills: Core Engineering - Apply: https://jobs.ashbyhq.com/thinkingmachines/a5559c53-7085-45ff-8a0f-5e47b5e822bc ## Description ABOUT THINKING MACHINES The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it. ABOUT THE ROLE We're hiring a Software Engineer to build and own our web-crawling systems, from distributed collection at internet scale through filtering, deduplication, and deciding what data we keep. The ideal candidate has built and scaled a web crawler or large-scale data-acquisition systems. In this role, you'll write and own production systems: the crawler itself, the infrastructure that runs it at scale, and the pipelines that turn raw crawls into usable pretraining data. You'll work closely with our pretraining and data teams to understand what's actually moving model quality, but this is fundamentally an engineering role, not a research one. WHAT YOU'LL DO - Design and scale the web crawler and ingestion infrastructure that sources Inkling's pretraining data - Build pipelines for large-scale extraction, deduplication, and data quality filtering - Build specialized crawlers for high-value or hard-to-reach data sources - Work with the pretraining team to understand how changes in crawled data affect model performance - Improve the reliability and efficiency of crawling and ingestion infrastructure at petabyte scale - Help set technical direction for this area as i More Thinking Machines roles: https://deviantjobs.com/companies/thinking-machines