agentgateway
Rust proxy for LLM, MCP and agent-to-agent traffic, with per-key budgets, guardrails and a built-in UI
Federates MCP servers and OpenAPI backends behind one endpoint with OAuth, per-tool CEL rules and guardrails, all free under the Linux Foundation. The fastest and lightest I tested, but it has no auth until you configure it.
- Ready in
- 5 s
- Memory in use at idle
- 9 MB of 4 GB
- Median tool call
- 6.1 ms
- Calls/s, 8 sessions
- 305
- Peak memory
- 16 MB
The lightest and fastest MCP gateway. 9 MB at idle and about 0.4 ms added per tool call. It accepts requests without any authentication until you configure it.
Commands, notes and screenshotsBest for
Teams that want one gateway for LLM calls, MCP servers and agents
Not for
Teams that need response caching in the gateway
- Handles LLM, MCP and A2A traffic in one proxy
- Runs as a single binary with no Kubernetes needed
- Per-key dollar budgets and a cost dashboard in the free version
- Several guardrail types that can run in sequence
- Rate limits are local to each instance unless you pay for Solo Enterprise
- No response caching
- Fast release pace means frequent upgrades
- In the simple LLM config, failover helps the next request while the failing one still errors
- Licence
- Apache-2.0 (permissive)
- Stack
- Rust
- Databases
- SQLite, PostgreSQL
- GitHub
- 5.8k stars · 286 contributors
- Latest release
- v1.7.0 · Oct 27, 2026
- SSO
- Free edition
- Audit logs
- Free edition