Get Started with Megatron-LM

Ongoing research for training transformer models at scale.

Getting Started

The Megatron-LM team maintains comprehensive docs that cover installation, configuration, and common patterns.

Megatron-LM offers a free tier — sign up to get started without any payment.

Our full tool profile covers Megatron-LM's strengths, weaknesses, pricing, and how it compares to alternatives.

Teams focused on pushing the boundaries of transformer model size and performance

Research institutions working on advanced NLP tasks