Evaluation & Testing

garak

LLM vulnerability scanner for robust model evaluation

Status
Generally available
Last checked
Checked · Oct 15, 2026
License
Open source
Pricing
Free tier · from $0
Visit garak Compare with alternatives

What it is

Garak is an open-source tool designed to scan and identify vulnerabilities in large language models. It helps developers ensure the security and reliability of their AI systems by providing comprehensive testing capabilities.

Garak stands out as an open-source, comprehensive LLM vulnerability scanner backed by NVIDIA, offering developers and data scientists a powerful tool to ensure their AI systems are secure and reliable.

When it fits — and when it doesn’t

A good fit for

  • Teams developing LLMs who need a robust vulnerability scanner to ensure model security and reliability.

  • Organizations that require comprehensive testing capabilities for their AI systems.

Look elsewhere if

  • Projects with limited resources or expertise in setting up self-hosted tools

  • Users looking for a fully managed service without the need for local setup

Known weaknesses

Each one links to the public issue, changelog or docs page it came from, where we have one.

  1. 01

    Limited integrations with non-Python environments

    Primary support is for Python, limited official support for other languages

  2. 02

    Documentation lacks depth and examples for advanced use cases

    Core documentation focuses on basic usage; advanced topics are sparse or missing

What it does well

  • Comprehensive vulnerability scanning for LLMs

  • Open-source and extensible framework

  • Support from NVIDIA, ensuring robust development and maintenance

Pricing

Free tier
YesOpen source — free to use
Paid from
$0
Model
Flat rate
Enterprise plan
No

Pricing not independently confirmed — check the vendor’s page.

Performance benchmarks

How Fast Is It?

Set up garak

Setup steps, common gotchas and what to check after 30 days.

Open the setup guide →
Get the badge

A small badge for garak’s README or site: its name, “Tracked on AI Navigator”, and the availability status and check month from this page. It updates as the catalog does.

garak — tracked on AI Navigator

Markdown

[![garak — tracked on AI Navigator](https://navigateaitools.com/badge/garak.svg)](https://navigateaitools.com/explorer/tool/garak)

HTML

<a href="https://navigateaitools.com/explorer/tool/garak"><img src="https://navigateaitools.com/badge/garak.svg" alt="garak — tracked on AI Navigator" height="58"></a>