Popular GitHub Repositories for Jailbreak

ChatGPT DAN, Jailbreaks prompt

List of free GPTs that doesn't require plus subscription

GPT 3.5/4 with a Chat Web UI. No API key required.

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

ChatGPT Jailbreaks, GPT Assistants Prompt Leaks, GPTs Prompt Injection, LLM Prompt Security, Super Prompts, Prompt Hack, Prompt Security, Ai Prompt Engineering, Adversarial Machine Learning.

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).

Awesome things you can do with ChatGPT + Code Interpreter combo ?

A cross-platform desktop client for the jailbroken New Bing AI Copilot (Sydney ver.) built with Go and Wails (previously based on Python and Qt).

Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, datasets, evaluations, and analyses.

A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.

A framework to evaluate the generalization capability of safety alignment for LLMs

LLM Jailbreaks, ChatGPT, Claude, Llama, DAN Prompts, Prompt Leaking

Prompts of GPT-4V & DALL-E3 to full utilize the multi-modal ability. GPT4V Prompts, DALL-E3 Prompts.

An autoreply bot on Reddit powered by Bing with customized settings

[AAAI'25 (Oral)] Jailbreaking Large Vision-language Models via Typographic Visual Prompts

[arXiv:2311.03191] "DeepInception: Hypnotize Large Language Model to Be Jailbreaker"

Browser userscript to automatically send DAN messages to ChatGPT

Bypass restricted and censored content on AI chat prompts ?

Framework for testing vulnerabilities of large language models (LLM).