Taro Logo

Software Engineer, AI Gateway - Shanghai

Kong Inc. is a leading developer of cloud API technologies, helping organizations become API-first and securely accelerate AI adoption.
Backend
Mid-Level Software Engineer
In-Person
2+ years of experience
AI · Enterprise SaaS

Description For Software Engineer, AI Gateway - Shanghai

Kong Inc. is seeking a Software Engineer for their AI Gateway team in Shanghai. This role is part of the Core Team, focusing on fundamental features like proxying capabilities, load balancing, and database support. Kong is a widely-adopted open-source project, serving developers and architects worldwide across various use-cases.

The position requires expertise in server-side programming, distributed systems, and Linux networking, with a focus on both L7 and L4 transports and protocols. The ideal candidate will have 2+ years of experience and be comfortable with low-level system optimization and troubleshooting. Knowledge of AI LLM concepts is essential as Kong works to enable secure AI adoption.

As part of Kong's mission to help organizations become "API-first," you'll be working on cutting-edge industry trends and use-cases. You'll be responsible for building foundations that other teams and customers rely on, while also engaging with the open-source community. The role offers the opportunity to work on highly scalable, distributed systems while contributing to documentation and product development.

Bonus qualifications include hands-on experience with NGINX/OpenResty/Kong/LuaJIT, Envoy or Istio, and Rust. The position requires strong communication skills as engineers at Kong write documentation for their products. This is an excellent opportunity for someone passionate about API technologies and interested in working at the intersection of AI and API management.

Last updated 4 hours ago

Responsibilities For Software Engineer, AI Gateway - Shanghai

  • Design, build and maintain API management software and its underlying stack
  • Architecture, design, and implement new innovative features including proxying capabilities, load balancing, databases support
  • Bugs troubleshooting, performance tuning and low-level optimizations
  • Engage with open source community and extend Kong core
  • Fill the gaps between Kong and third-party deployment platforms and tooling

Requirements For Software Engineer, AI Gateway - Shanghai

Rust
  • 2+ years of programming in server-side applications and components
  • Experience designing, prototyping, building and debugging highly scalable, distributed applications
  • Solid hands-on low-level technical expertise in Linux systems troubleshooting, and profiling
  • Experience in distributed systems, Linux networking stack and computer systems programming
  • Strong sense of ownership and excellent verbal and written communication skills
  • Familiarity with AI LLM concepts and application development
  • Comfortable working with a remotely distributed team

Interested in this job?

Jobs Related To Kong Software Engineer, AI Gateway - Shanghai