LLM Gateway SDK
SDK for developing plugins for the LLM Gateway
Pricing
Free tier
Flat rate
Adoption
→StableLicense
Open Source
Data freshness
UnverifiedOverview
What is LLM Gateway SDK?
The @nullplatform/llm-gateway-sdk is an SDK designed to facilitate plugin development for the LLM Gateway, enabling developers to extend and customize language model functionalities.
Key differentiator
“The @nullplatform/llm-gateway-sdk stands out by offering a flexible and community-driven approach to plugin development, allowing developers to easily extend LLM Gateway functionalities.”
Capability profile
Capability Radar
Honest assessment
Strengths & Weaknesses
↑ Strengths
↓ Weaknesses
API requires Python-specific patterns, TypeScript SDK is community-maintained
v0.1 to v0.2 migration required rewriting chain definitions
Official SDK only supports JS/TS and Python, other languages require community-maintained forks
Not optimized for high throughput scenarios, observed delays in processing requests at scale
Fit analysis
Who is it for?
✓ Best for
Teams looking to extend the functionality of their existing LLM Gateway installations with custom plugins
Developers who need a flexible and extensible framework for integrating various services into language model workflows
✕ Not a fit for
Projects requiring real-time streaming capabilities, as the SDK is designed around batch processing
Teams looking for a fully managed service without self-hosting requirements
Cost structure
Pricing
Free Tier
Available
Open source — free to use
Starts at
$0
Model
Flat rate
Enterprise
None
Performance benchmarks
How Fast Is It?
Ecosystem
Relationships
Next step
Get Started with LLM Gateway SDK
Step-by-step setup guide with code examples and common gotchas.