Get Started with exllama

Memory-efficient rewrite of HF transformers for quantized weights

Getting Started

The exllama team maintains comprehensive docs that cover installation, configuration, and common patterns.

exllama offers a free tier — sign up to get started without any payment.

Our full tool profile covers exllama's strengths, weaknesses, pricing, and how it compares to alternatives.

Teams working with LLaMA models who need to optimize memory usage

Developers building applications on devices with limited RAM

Researchers testing large language models on budget-friendly hardware