Senior LLMOps Engineer

Kong is seeking a Senior LLMOps Engineer to join their team in Bangalore as a founding member of their new LLMOps platform team. This role is crucial in powering Kong's API Management suite, including the Kong Enterprise AI Gateway and Konnect, which support multiple AI capabilities for customers. The position focuses on building and managing a LLM SaaS platform that will serve all engineering teams at Kong, ensuring high reliability and security.

The AI Gateway offers a unified API for managing multiple Large Language Models (LLMs), allowing seamless switching between different AI providers. It implements various AI policies such as semantic caching, advanced routing and load balancing, prompt guards, and PII sanitization. The platform must maintain high reliability with 99.99% uptime SLOs while supporting the company's AI innovation initiatives.

As the founding member of the LLMOps team, you'll be responsible for shaping the technical direction of AI innovation at Kong, collaborating with product leadership, and helping grow the team. The role requires extensive experience in SaaS/PaaS systems, cloud platforms, and AI technologies, combined with strong communication skills and incident management capabilities.

This is an excellent opportunity for a senior engineer passionate about AI and distributed systems to make a significant impact on a company's AI infrastructure and help shape the future of API management with AI capabilities. The hybrid work environment in Bangalore offers flexibility while maintaining team collaboration.