Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

Open-source AI penetration testing tool to find and fix your app’s vulnerabilities.

the LLM vulnerability scanner

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

🐢 Open-Source Evaluation & Testing library for LLM Agents

A full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

The Security Toolkit for LLM Interactions

Sandbox any AI agent in seconds - zero setup, zero latency.

A secure low code deception runtime framework, leveraging AI for System Virtualization.

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.

OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)

A security scanner for your LLM agentic workflows

An easy-to-use Python framework to generate adversarial jailbreak prompts.

Open-source AI agent firewall for MCP security and agent egress. Scans mediated HTTP, MCP, A2A, and WebSocket traffic for exfiltration, SSRF, and prompt injection, and emits mediator-signed action receipts: verifiable audit evidence from outside the agent.

Local security audit for AI API relays and LLM proxies: detects prompt injection, model substitution, tool-call rewriting, SSE anomalies, error leakage, and Web3 wallet risks.

AI-first security scanner. NEW in v2026.7: Claude Code compromise detection — vet .claude/ hooks, permissions & skills before you clone — plus an always-on AI attack-signature scanner and native Rust & PHP rules. Also: medusa scan --git to vet any repo, medusa secrets scan for leaked API keys. 40,000+ patterns, zero setup.

Papers and resources related to the security and privacy of LLMs 🤖

Catch your AI's mistakes and blind spots before your customers or regulators do. iFixAi runs 45 inspections, 32 graded core plus 13 extended for frontier risks like sabotage, sandbagging, and oversight evasion. It returns a letter grade in under 5 minutes. Industry and model agnostic.