Popular GitHub Repositories for Red Tea

所有系统提示都需透明公开

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

? Open-Source Evaluation & Testing library for LLM Agents

? Open-Source Evaluation & Testing for AI & LLM systems

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

A.I.G (AI-Infra-Guard) is a comprehensive, intelligent, and easy-to-use AI Red-Teaming platform developed by Tencent's Zhuque Lab.

Agentic LLM Vulnerability Scanner / AI red teaming kit ?

A secure sandbox environment for malware developers and red teamers to test payloads against detection mechanisms before deployment. Integrates with LLM agents via MCP for enhanced analysis capabilities.

Visually build a full featured chat bot for Telegram, Facebook Messenger, Whatsapp and Slack with Node-RED. Almost no coding skills required.

A security scanner for your LLM agentic workflows

A script for credentials-based attack surface enumeration and general reconnaissance of massive networks

Scalable, secure workflow solution

ACM Multimedia 2023: DocDiff: Document Enhancement via Residual Diffusion Models. Also contains 1597 red seals in Chinese scenes, along with their corresponding binary masks.

? Autoxsh is an open-source tool that utilizes OpenAI's API to automate the generation and publishing of content on Xiaohongshu (Little Red Book), including images, titles, text, and tags.

Security automation with n8n ideas: 100+ Red/Blue/AppSec workflows, integrations, and ready-to-run playbooks.

Autonomous Multi-Agent Based Red Team Testing Service

Framework for testing vulnerabilities of large language models (LLM).

[NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"

Automated prompt-based testing and evaluation of Gen AI applications