Get Started with GPT-NeoX

Model parallel autoregressive transformers on GPUs based on DeepSpeed.

Getting Started

The GPT-NeoX team maintains comprehensive docs that cover installation, configuration, and common patterns.

Visit the GPT-NeoX website to create your account and explore pricing options.

Our full tool profile covers GPT-NeoX's strengths, weaknesses, pricing, and how it compares to alternatives.

Teams needing to train large-scale autoregressive transformers on GPUs

Projects that require efficient model parallelism and performance optimization