API · Frontend
YOUR FOCUS
Feature development: Design and ship new platform capabilities - from supporting new model architectures and serving frameworks to building out API features that customers are asking for.
Customer-facing engineering: Work closely with customers and the commercial team to understand real-world usage patterns, translate feature requests into technical designs, and iterate based on feedback.
Developer experience: Improve the end-to-end experience of deploying and running inference on Lyceum, from initial setup through to monitoring and debugging in production.
YOUR KPIS
- Number of platform features shipped
- Time from customer request to feature availability
- Breadth of supported models, frameworks, and deployment configurations
YOUR PROFILE
We consider candidates from diverse backgrounds, with a deep love for technical challenges and the desire to take on ownership beyond what's reasonably expected. You're someone who stays close to the rapidly evolving open-source AI ecosystem and gets energy from turning emerging tools into production-grade platform capabilities.
Requirements
- 3+ years of experience in software engineering, with a focus on backend or infrastructure systems
- Strong proficiency in Go and Python
- Hands-on experience with at least one ML inference serving framework (vLLM, TGI, etc)
- Solid understanding of how large language models and other AI models are deployed and served in production
- Experience working with REST/gRPC APIs and designing developer-facing interfaces
Nice to have
- Familiarity with GPU scheduling,