LLM Orchestration

LLM Gateway SDK

SDK for developing plugins for the LLM Gateway

Status
Not yet determined
Last checked
Stale
License
Open source
Pricing
Free tier · from $0
Visit LLM Gateway SDK Compare with alternatives

What it is

The @nullplatform/llm-gateway-sdk is an SDK designed to facilitate plugin development for the LLM Gateway, enabling developers to extend and customize language model functionalities.

The @nullplatform/llm-gateway-sdk stands out by offering a flexible and community-driven approach to plugin development, allowing developers to easily extend LLM Gateway functionalities.

When it fits — and when it doesn’t

A good fit for

  • Teams looking to extend the functionality of their existing LLM Gateway installations with custom plugins

  • Developers who need a flexible and extensible framework for integrating various services into language model workflows

Look elsewhere if

  • Projects requiring real-time streaming capabilities, as the SDK is designed around batch processing

  • Teams looking for a fully managed service without self-hosting requirements

Known weaknesses

Each one links to the public issue, changelog or docs page it came from, where we have one.

  1. 01

    Limited language support beyond JavaScript and Python

    Official SDK only supports JS/TS and Python, other languages require community-maintained forks

  2. 02

    Performance bottlenecks with large-scale deployments

    Not optimized for high throughput scenarios, observed delays in processing requests at scale

What it does well

  • Extensive documentation and examples for plugin development

  • Flexible architecture to integrate with various language models

  • Community-driven support and contributions

Pricing

Free tier
YesOpen source — free to use
Paid from
$0
Model
Flat rate
Enterprise plan
No

Pricing not independently confirmed — check the vendor’s page.

Performance benchmarks

How Fast Is It?

Set up LLM Gateway SDK

Setup steps, common gotchas and what to check after 30 days.

Open the setup guide →
Get the badge

A small badge for LLM Gateway SDK’s README or site: its name, “Tracked on AI Navigator”, and the availability status and check month from this page. It updates as the catalog does.

LLM Gateway SDK — tracked on AI Navigator

Markdown

[![LLM Gateway SDK — tracked on AI Navigator](https://navigateaitools.com/badge/nullplatform-llm-gateway-sdk.svg)](https://navigateaitools.com/explorer/tool/nullplatform-llm-gateway-sdk)

HTML

<a href="https://navigateaitools.com/explorer/tool/nullplatform-llm-gateway-sdk"><img src="https://navigateaitools.com/badge/nullplatform-llm-gateway-sdk.svg" alt="LLM Gateway SDK — tracked on AI Navigator" height="58"></a>