Kong
Senior Software Engineer, AI Gateway - Shanghai
Shanghai, China
hirly Pro
Get in front of the people hiring at Kong
- Reach the hiring manager at Kong on LinkedIn, from your own account
- hirly applies to this job for you, with unlimited applications
- A resume and cover letter written for this job, unlimited
- The hiring manager and recruiter at Kong, with contact details
$49 a month · ₹1,999 for 30 days in India · cancel any time
Get past the screening software and onto a recruiter's desk
hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.
- Keywords matched to this posting
- Fit score before you apply
- Cover letter included
Matched against 2.8M live jobs from 220,000+ employers in 200+ countries.
Tailor my resume for this job →Apply from your AI assistant
Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.
Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.
hirly's read of this role
- Role family
- Engineering
- Seniority
- Senior
- Country
- CN
- Work mode
- On-site / unstated
- First seen by hirly
- 23 Oct 2026
Derived automatically from the posting. Upload your resume above to see how the role scores against it.
the posting
Are you ready to unlock intelligence?
If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.
About the Role:
As Kong advances into the Agentic Era, the AI Gateway team is developing the vital infrastructure that links enterprise systems with generative AI technologies. In this position, you will focus on engineering the core system powering live AI traffic. You will take ownership of the runtime and data plane responsible for routing, translating, securing, and analyzing every request, ensuring performance, security, and scalability as AI workloads expand.
What You'll Do:
Responsible for designing, building and maintaining Kong’s AI Gateway runtime and its underlying data plane stack.
Architecture, design, and implement new innovative features including proxying capabilities, semantic/intelligent routing, load balancing, guardrails and compression, and identity, that extend Kong’s AI Gateway offering.
Build and maintain security, performance, and compliance foundations, including token cost management, access control, and low-level optimizations for production AI workloads.
Engage with the open source community and extend Kong core to support the latest industry trends.
Fill the gaps between Kong AI Gateway and third-party AI/ML providers, deployment platforms, and tooling.
And any additional tasks required by the manager.
What You'll Bring:
8+ years of programming in server-side applications and components.
Experience designing, prototyping, building and debugging applications that are highly scalable, distributed, reliable and resilient.
Solid hands-on low-level technical expertise in Linux systems troubleshooting, and profiling.
Experience in distributed systems, Linux networking stack and computer systems programming, Kong works with APIs on both L7 and L4 transports and protocols, so this expertise and knowledge are required.
Comfortable working with a remotely distributed team.
Strong sense of ownership and excellent verbal and written communication skills.
Familiarity with AI LLM concepts and applications development.
Bonus Points:
Hands-on experience with NGINX/OpenResty/Kong/LuaJIT.
Hands-on experience with Envoy or Istio.
Hands-on experience with Rust.
Hands-on experience leveraging AI agents to deliver intricate software systems efficiently and with superior quality.
#LI-WL1
About Kong:
Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit www.konghq.com .
Listed on hirly, a job board. hirly is not the employer: Kong is hiring for this role.
Similar jobs
- Senior Software Engineer, Tools - Unpublished R&D ProductRiotgames · Shanghai, ChinaFirst seen 21d agoremote
- Staff Software EngineerPaypal · Shanghai, ChinaFirst seen 7d ago
- Sr. Software Engineer - AI RegulatoryGehc · WuXiFirst seen 7d ago
- Senior Software EngineerAbound · ShenzhenFirst seen 10d ago
- Junior Software EngineerVirtuos · Shanghai, ChinaFirst seen 13d ago
Browse similar roles
Want this one?
Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.
Tailor my resume for this job