Agentgateway

Agentgateway is an open-source gateway built specifically for AI-native infrastructure. Written in Rust, it acts as a single data plane that routes and secures traffic between applications, large language model providers, Model Context Protocol (MCP) tool servers, and agent-to-agent (A2A) communication, rather than requiring separate tools for each type of traffic. It supports standard HTTP and gRPC routing alongside newer agentic protocols, so teams can manage microservice APIs and agent workloads through the same proxy layer. The tool is aimed at platform engineers and AI infrastructure teams building agentic systems that need governance, visibility, and interoperability across many agents, tools, and models. It includes an LLM gateway with an OpenAI-compatible API that routes across providers such as OpenAI, Anthropic, Google Gemini, and AWS Bedrock, plus an MCP gateway for tool discovery, access control, and audit trails. Observability is handled through OpenTelemetry integration, and it supports policy evaluation and PII redaction for governance needs. Agentgateway originated at Solo.io and has since been donated to the Linux Foundation's Agentic AI Foundation, giving it a vendor-neutral open-source home. It ships as a standalone binary, Docker container, or Kubernetes deployment via Helm. As a young, infrastructure-layer project, it assumes teams already run agentic workloads at some scale and are comfortable with proxy and gateway configuration rather than a plug-and-play consumer setup.