Engineering
Senior Software Engineer - (Agent Training and Evals)
Engineering
Prolific
Prolific is not just another player in the AI space – we are the architects of the human data infrastructure that's reshaping the landscape of AI development. In a world where foundational AI technologies are increasingly commoditized, it's the quality and diversity of human-generated data that truly differentiates products and models.
The role
- As a Senior Software Engineer, you'll be one of the first engineers on our Agent Training & Evals team.
- You'll build infrastructure to evaluate AI agents at scale against real human expertise, in safe and secure environments. The better we get at this, the more useful, reliable and safe agents become.
- This is a genuine 0→1 role. There isn't a well-established playbook or existing architecture for you to simply maintain. You’ll shape the team’s technical direction and the products we build.
- You'll work closely with engineering, product and AI research to turn ambiguous problems into scalable systems, and you'll see the impact of what you build directly.
What you’ll be doing in the role
- Build a platform to support evaluating and fine-tuning agents
- Take prototypes to production; turn experiments and research ideas into reliable, well-tested software
- Own what we ship as it scales in production
- Solve hard problems around data, compute, orchestration, scaling, security and reliability
- Work with emerging agentic AI technologies and rapidly evolving models
- Make effective product and technical decisions in a highly experimental environment