Popular GitHub Repositories for Blue Teaming

所有系统提示都需透明公开

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

A.I.G (AI-Infra-Guard) is a comprehensive, intelligent, and easy-to-use AI Red-Teaming platform developed by Tencent's Zhuque Lab.

Agentic LLM Vulnerability Scanner / AI red teaming kit ?

A security scanner for your LLM agentic workflows

Security automation with n8n ideas: 100+ Red/Blue/AppSec workflows, integrations, and ready-to-run playbooks.

Framework for testing vulnerabilities of large language models (LLM).

[NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"

Automated prompt-based testing and evaluation of Gen AI applications

Papers about red teaming LLMs and Multimodal models.

Top 10 for Agentic AI (AI Agent Security) serves as the core for OWASP and CSA Red teaming work

Whistleblower is a offensive security tool for testing against system prompt leakage and capability discovery of an AI application exposed through API. Built for AI engineers, security researchers and folks who want to know what's going on inside the LLM-based app they use daily

AI Alignment: A Comprehensive Survey

Blackdagger is a DAG-based automation tool specifically used in DevOps, DevSecOps, MLOps, MLSecOps, and Continuous Red Teaming (CART).

Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment

AI Red Teaming Range

AspGoat is an intentionally vulnerable ASP.NET Core application for learning and practicing web application security.

Code Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models

BeaconatorC2 is a framework for red teaming and adversarial emulation, providing a full-featured management interface, along with a catalog of beacons and a clear schema to add more beacons over time.