Software Development · Italy

Hybrid Full-time

Software Engineer AI Gateway

Kong · Italy · Posted Jun 17, 2026

This posting comes from Kong. Confirm the details on their site before applying.

Overview

You will join the engineering team that builds the Kong AI gateway, empowering companies and developers around the world to govern every step of their AI & LLM based innovation. As a Software Engineer in the AI Gateway Team, you will be working on core features such as multi-LLM routing and balancing, semantic caching and routing, MCP, and more.

Responsibilities

  • Partake in the entire lifecycle of core AI Gateway features, from design to production rollout.
  • Build and maintain high-performance components for Kong’s AI Gateway in Rust and Lua.
  • Implement gateway features such as multi-LLM routing and load balancing, caching, guardrails, and observability for AI traffic.
  • Design integrations with LLM providers and AI platforms, filling the gaps between Kong and third-party deployment platforms and tooling.
  • Troubleshoot production issues in the hot path.
  • Work with product management and other engineering teams to turn customer requirements into reliable, documented product features.

Requirements

  • 3+ years of programming in server-side applications and components, in a language such as Rust or Go.
  • Experience building and debugging applications that are highly scalable, distributed, reliable and resilient.
  • Knowledge of networking fundamentals and protocols on both L4 and L7 (TCP/IP, HTTP/2, gRPC).
  • Familiarity with cutting-edge AI models concepts, agentic AI protocols, and AI applications development.
  • Solid hands-on expertise in Linux systems.
  • Ownership: You have a strong sense of ownership, including the documentation: engineers at Kong write the documentation for their products.
  • Collaboration: You have excellent verbal and written communication skills and are comfortable working with a remotely distributed team.

Preferred qualifications

  • Proficiency with Lua.
  • Hands-on experience with NGINX and OpenResty.
  • Familiarity with cloud-native environments (Kubernetes, Docker, AWS/GCP/Azure).

Benefits

  • Bonus

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.