ai-watson-openscale

? Open-Source Evaluation & Testing for AI & LLM systems

A Python package to assess and improve fairness of machine learning models.

WEFE: The Word Embeddings Fairness Evaluation Framework. WEFE is a framework that standardizes the bias measurement and mitigation in Word Embeddings models. Please feel welcome to open an issue in case you have any questions or a pull request if you want to contribute to the project!

The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.

Safety Score for Pre-Trained Language Models

Papers and online resources related to machine learning fairness

A curated list of awesome academic research, books, code of ethics, data sets, institutes, maturity models, newsletters, principles, podcasts, reports, tools, regulations and standards related to Responsible, Trustworthy, and Human-Centered AI.

FairPut - Machine Learning Fairness Framework with LightGBM — Explainability, Robustness, Fairness (by @firmai)

Fairness Aware Machine Learning. Bias detection and mitigation for datasets and models.

PyTorch package to train and audit ML models for Individual Fairness