Antirion, an open-source AI gateway that ships as one Rust binary

Antirion is a new open-source (Apache 2.0) gateway that sits between your apps and model providers such as OpenAI, Anthropic, Amazon Bedrock, Google Vertex AI, Gemini, Mistral and DeepSeek. It ships as a single Rust binary with a web console built in. Features include fallback and cost-based routing, budgets and rate limits per team, project or key, caching, and guardrails for things like personal data and secrets. The project's own benchmark, on a 4 vCPU AWS machine at 5,000 requests a second, shows 0.53 ms median overhead against 19.7 ms for Bifrost 2.2.4, while LiteLLM 1.103.1 returned errors on every request. These are the author's figures, not independent tests, and the repo is only a few days old.