Tools › Security & Privacy › garak

garak

Stress-tests LLMs with known jailbreaks and probes

🔒 Security & Privacy ★ 10.1k +12 this week Intermediate

What it is

Garak is NVIDIA's open-source LLM vulnerability scanner. It is for AI engineers and security teams who want to test chatbots and model integrations against known prompt-injection, jailbreak, and data-leakage attacks.

How it works

It runs families of probes against a target model, including role-play jailbreaks, encoded instructions, and training-data extraction bait, then scores responses for attack success. Results can be compared like port scans to measure how often a model gives in.

Use cases

  • Scan a customer-facing chatbot before launch for known jailbreak and prompt-injection failures.
  • Compare model or guardrail versions by attack success rate in CI.
  • Evaluate whether safety instructions hold up against role-play attacks.
  • Red-team internal RAG or agent endpoints for data-leakage prompts.

💰 Business opportunities

  • Sell pre-launch LLM security assessments and remediation reports.
  • Offer continuous AI red-team monitoring for companies deploying chatbots.
  • Build compliance evidence packages showing guardrail testing coverage.

Featured in 1 video

10 GitHub Repos That Should Be Illegal 2026

Electronic Tech Show · 2026-11-07

Similar tools

TradingAgents

A pretend trading firm staffed entirely by AI agents

💼 Finance & Business ★ 123k +100 wk Python

Claude Plugins Official

Official Claude Code plugin directory with security and coding skills

🛠️ Coding & Developer Tools ★ 47.6k +88 wk Python

Investment Council

AI panel of legendary investors debating every stock pick

💼 Finance & Business ★ 85 Python

Sherlock

Find a username across hundreds of social networks

🔒 Security & Privacy ★ 113.9k +509 wk Python

Cloudflare Security Audit Skill

Multi-phase security audits with verified, machine-readable findings

🔒 Security & Privacy ★ 74.9k +752 wk JavaScript

Vaultwarden

Self-hosted Bitwarden-compatible password manager server

🔒 Security & Privacy ★ 70.9k +57 wk Rust