Hallucination Leaderboard
LLM Performance Comparison for Document Summarization Hallucinations
Pricing
Free tier
Flat rate
Adoption
↗RisingLicense
Open Source
Data freshness
Verified · Jul 16, 2026Overview
What is Hallucination Leaderboard?
The Hallucination Leaderboard evaluates and compares the performance of Large Language Models in producing hallucinations when summarizing short documents, providing insights into model reliability.
Key differentiator
“The Hallucination Leaderboard is the only open-source tool dedicated to evaluating and comparing LLMs specifically on their tendency to produce hallucinations when summarizing short documents.”
Capability profile
Capability Radar
Honest assessment
Strengths & Weaknesses
↑ Strengths
↓ Weaknesses
API requires Python-specific patterns, TypeScript SDK is community-maintained
v0.1 to v0.2 migration required rewriting chain definitions
Primary development and documentation focus on Python, limited SDKs for other languages
Requires setting up multiple dependencies and services, detailed configuration steps
Fit analysis
Who is it for?
✓ Best for
Researchers studying the reliability and accuracy of LLMs in document summarization tasks
Teams needing a tool to benchmark different language models for hallucination tendencies
Developers who want an open-source solution to evaluate model performance
✕ Not a fit for
Projects requiring real-time evaluation or monitoring of hallucinations
Users looking for a cloud-based service without self-hosting capabilities
Cost structure
Pricing
Free Tier
Available
Open source — free to use
Starts at
$0
Model
Flat rate
Enterprise
None
Performance benchmarks
How Fast Is It?
Ecosystem
Relationships
Integrations
Next step
Get Started with Hallucination Leaderboard
Step-by-step setup guide with code examples and common gotchas.