LLM Orchestration

LLM Gateway

Main proxy server for LLM Gateway Core

Status
Generally available
Last checked
Checked · Oct 16, 2026
License
Open source
Pricing
Free tier · from $0
Visit LLM Gateway Compare with alternatives

What it is

LLM Gateway Core is a main proxy server designed to facilitate communication between various language model services and applications. It simplifies the integration of AI models into existing systems, enhancing observability and management.

LLM Gateway Core stands out by offering a simplified, self-hosted solution for integrating and managing multiple language models, providing enhanced observability without the need for cloud services.

When it fits — and when it doesn’t

A good fit for

  • Developers who need to integrate multiple AI models into their applications without complex setup

  • Teams looking for enhanced observability and management over their AI services

  • Projects requiring self-hosted solutions for full control over infrastructure

Look elsewhere if

  • Users needing real-time streaming capabilities (batch-only architecture)

  • Budget-constrained projects where cost-efficiency is a primary concern

Known weaknesses

Each one links to the public issue, changelog or docs page it came from, where we have one.

  1. 01

    Limited integrations with non-JavaScript languages

    Primary language support is JavaScript, limited official SDKs for other languages

  2. 02

    Complex setup and configuration process

    Documentation lacks step-by-step guides for common deployment scenarios

What it does well

  • Simplified integration of AI models into applications

  • Enhanced observability and management of language model services

  • Self-hosted deployment for full control over infrastructure

Pricing

Free tier
YesOpen source — free to use
Paid from
$0
Model
Flat rate
Enterprise plan
No

Pricing not independently confirmed — check the vendor’s page.

Performance benchmarks

How Fast Is It?

Set up LLM Gateway

Setup steps, common gotchas and what to check after 30 days.

Open the setup guide →
Get the badge

A small badge for LLM Gateway’s README or site: its name, “Tracked on AI Navigator”, and the availability status and check month from this page. It updates as the catalog does.

LLM Gateway — tracked on AI Navigator

Markdown

[![LLM Gateway — tracked on AI Navigator](https://navigateaitools.com/badge/nullplatform-llm-gateway.svg)](https://navigateaitools.com/explorer/tool/nullplatform-llm-gateway)

HTML

<a href="https://navigateaitools.com/explorer/tool/nullplatform-llm-gateway"><img src="https://navigateaitools.com/badge/nullplatform-llm-gateway.svg" alt="LLM Gateway — tracked on AI Navigator" height="58"></a>