Get Started with exllama

Memory-efficient rewrite of HF transformers for quantized weights

Getting Started

The exllama team maintains comprehensive docs that cover installation, configuration, and common patterns.

Visit the exllama website to create your account and explore pricing options.

Our full tool profile covers exllama's strengths, weaknesses, pricing, and how it compares to alternatives.

Teams working with LLaMA models who need to optimize memory usage

Developers building applications on devices with limited RAM

Researchers testing large language models on budget-friendly hardware