Popular GitHub Repositories for Reliability Assessment

This repository is primarily maintained by Omar Santos (@santosomar) and includes thousands of resources related to ethical hacking, bug bounties, digital forensics and incident response (DFIR), artificial intelligence security, vulnerability research, exploit development, reverse engineering, and more.

The most reliable AI agent framework that supports MCP.

the LLM vulnerability scanner

Convolutional Neural Networks to predict the aesthetic and technical quality of images.

A Python package to assess and improve fairness of machine learning models.

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

Quark Agent - Your AI-powered Android APK Analyst

Measures and metrics for image2image tasks. PyTorch.

A Collection of Papers and Codes for CVPR2025/CVPR2024/CVPR2021/CVPR2020 Low Level Vision

A comprehensive collection of IQA papers

Your 24/7 On-Call AI Agent - Solve Alerts Faster with Automatic Correlations, Investigations, and More

FaceXlib aims at providing ready-to-use face-related functions based on current STOA open-source methods.

NISQA - Non-Intrusive Speech Quality and TTS Naturalness Assessment

Awesome-LLM-Robustness: a curated list of Uncertainty, Reliability and Robustness in Large Language Models

Privacy Meter: An open-source library to audit data privacy in statistical and machine learning algorithms.

MagFace: A Universal Representation for Face Recognition and Quality Assessment, CVPR2021, Oral

Artemis - Interactive Learning with Automated Feedback

Govern, Secure, and Optimize your AI Traffic. AI Gateway provides unified interface to all LLMs using OpenAI API format with a focus on performance and reliability. Built in Rust.

Amazon Bedrock Agentcore accelerates AI agents into production with the scale, reliability, and security, critical to real-world deployment.