Model Hubs & Serving

Gateway

Blazing Fast AI Gateway for routing to over 100 LLMs with a single API.

Status
Generally available
Last checked
Checked · Oct 16, 2026
License
Open source
Pricing
Free tier · from $0
Visit Gateway Compare with alternatives

What it is

Gateway is an open-source project that provides a fast and friendly API for routing requests to more than 100 large language models (LLMs). It simplifies the process of integrating multiple LLMs into applications, making it easier for developers to leverage AI capabilities without managing individual APIs.

Gateway stands out by offering a unified API for over 100 LLMs, providing developers with the flexibility to integrate multiple models efficiently without managing individual APIs.

When it fits — and when it doesn’t

A good fit for

  • Developers who need to integrate multiple large language models into their applications and want a single, fast API.

  • Teams working on AI projects that require quick access to various LLMs without managing individual APIs.

  • Projects where performance in routing requests is critical.

Look elsewhere if

  • Scenarios requiring real-time streaming capabilities as Gateway focuses on request-based operations.

  • Use cases needing a managed service with built-in support and maintenance, as Gateway requires self-hosting.

Known weaknesses

Each one links to the public issue, changelog or docs page it came from, where we have one.

  1. 01

    Small community and limited third-party integrations

    GitHub repository has fewer than 10 contributors and lacks extensive third-party plugins or extensions

What it does well

  • Supports over 100 LLMs with a single API.

  • Blazing fast performance for routing requests.

  • Easy to integrate into existing applications.

  • Open-source and community-driven development.

  • Flexible configuration options.

Pricing

Free tier
YesOpen source — free to use
Paid from
$0
Model
Flat rate
Enterprise plan
No

Pricing not independently confirmed — check the vendor’s page.

Performance benchmarks

How Fast Is It?

Set up Gateway

Setup steps, common gotchas and what to check after 30 days.

Open the setup guide →
Get the badge

A small badge for Gateway’s README or site: its name, “Tracked on AI Navigator”, and the availability status and check month from this page. It updates as the catalog does.

Gateway — tracked on AI Navigator

Markdown

[![Gateway — tracked on AI Navigator](https://navigateaitools.com/badge/gateway.svg)](https://navigateaitools.com/explorer/tool/gateway)

HTML

<a href="https://navigateaitools.com/explorer/tool/gateway"><img src="https://navigateaitools.com/badge/gateway.svg" alt="Gateway — tracked on AI Navigator" height="58"></a>