# Senior Software Engineer, AI Gateway - Shanghai at Kong

- Company: Kong
- Status: Open
- Workplace: On-site
- Location: Shanghai, China
- Level: Senior
- Discipline: AI & ML
- Employment: Full-time
- Posted: 2026-10-23
- Skills: All Cost Center, ENG
- Apply: https://jobs.ashbyhq.com/kong/bf59414d-ae9d-4a16-adc9-ebe738e7f872

## Description

Are you ready to unlock intelligence?

If you don’t think you meet all of the criteria below but are still interested in the job, please apply.  Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.



About the Role:

As Kong advances into the Agentic Era, the AI Gateway team is developing the vital infrastructure that links enterprise systems with generative AI technologies. In this position, you will focus on engineering the core system powering live AI traffic. You will take ownership of the runtime and data plane responsible for routing, translating, securing, and analyzing every request, ensuring performance, security, and scalability as AI workloads expand.



What You'll Do:

 - Responsible for designing, building and maintaining Kong’s AI Gateway runtime and its underlying data plane stack.

 - Architecture, design, and implement new innovative features including proxying capabilities, semantic/intelligent routing, load balancing, guardrails and compression, and identity, that extend Kong’s AI Gateway offering.

 - Build and maintain security, performance, and compliance foundations, including token cost management, access control, and low-level optimizations for production AI workloads.

 - Engage with the open source community and extend Kong core to support the latest industry trends.

 - Fill the gaps between Kong AI Gateway and third-party AI/ML providers, deployment platforms, and tooling.

 - And any additional tasks required by the manager.



What You'll Bring:

More Kong roles: https://deviantjobs.com/companies/kong