Popular GitHub Repositories for Jailbreaks

ChatGPT DAN, Jailbreaks prompt

ChatGPT Jailbreaks, GPT Assistants Prompt Leaks, GPTs Prompt Injection, LLM Prompt Security, Super Prompts, Prompt Hack, Prompt Security, Ai Prompt Engineering, Adversarial Machine Learning.

Leaked GPTs Prompts Bypass the 25 message limit or to try out GPTs without a Plus subscription.

Agentic LLM Vulnerability Scanner / AI red teaming kit ?

A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.

? Vigil ? Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs

LLM Jailbreaks, ChatGPT, Claude, Llama, DAN Prompts, Prompt Leaking

A place to store jailbreaks, results of some prompts, or helpful utilities

Whistleblower is a offensive security tool for testing against system prompt leakage and capability discovery of an AI application exposed through API. Built for AI engineers, security researchers and folks who want to know what's going on inside the LLM-based app they use daily

A prompt injection game to collect data for robust ML research

First-of-its-kind AI benchmark for evaluating the protection capabilities of large language model (LLM) guard systems (guardrails and safeguards)

[CVPR2025] Official Repository for IMMUNE: Improving Safety Against Jailbreaks in Multi-modal LLMs via Inference-Time Alignment

LMAP (large language model mapper) is like NMAP for LLM, is an LLM Vulnerability Scanner and Zero-day Vulnerability Fuzzer.

Wanted to jailbreak an AI? Now you can with this amazing list of jailbreaks.

This repository contains the data and Python script used to generate insights and a taxonomy of language model safeguards bypassing techniques within Generative AI (Gen-AI) systems, as presented in the research paper "Taxonomy of Gen-AI Jailbreaks."

Improving Safety Against Jailbreaks in Multi-modal LLMs via Inference-Time Alignment

Zero-trust security framework for OpenAI Custom GPTs. Hardened system prompts and modular knowledge files prevent prompt injection, data leaks, and jailbreaks. Ready-to-deploy templates with OWASP alignment.