# Staff Machine Learning Engineer, LLM Inference Optimization at Nebius

- Company: Nebius
- Status: Open
- Workplace: On-site
- Location: Amsterdam, Netherlands; Berlin, Germany; London, United Kingdom; Poland; Prague, Czech Republic; Zurich, Switzerland
- Level: Staff
- Discipline: AI & ML
- Employment: Full-time
- Posted: 2026-10-21
- Skills: ML
- Apply: https://careers.nebius.com/?gh_jid=5012275101

## Description

About Nebius: 
 Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.
 Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.
 Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.
 Role Summary
 Nebius Token Factory is building production-grade inference for open-source, customer, and internally optimized models. This role owns the path from model artifact to fast, reliable, cost-efficient endpoint. The work sits at the intersection of model internals, inference engines, serving architecture, benchmarking, and production deployment.
 What You Will Do
• 
 Own a platform-level optimization pillar such as quantization, speculative decoding, KV -cache optimization, engine selection, or long-context serving.
• 
 Create reusable evaluation, benchmarking, and rollout frameworks across multiple model families.
• 
 Provide technical direction to MLEs, Applied Scientists, GPU kernel engineers, and infrastructure engineers on shared performance goals.
• 
 Optimize LLM and VLM endpoints for latency, throughput, memory e

More Nebius roles: https://deviantjobs.com/companies/nebius