Popular GitHub Repositories for Benchmark Framework

Repository for benchmarking graph neural networks (JMLR 2023)

A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.

All-in-one Web Agent framework for post-training. Start building with a few clicks!

?? Flex those feathers!

Evaluation Tool for Anomaly Detection Algorithms on Time Series

SPECTRA: Spectral framework for evaluation of biomedical AI models

Deep Learning Inference benchmark. Supports OpenVINO? toolkit, TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN, MXNet, PyTorch, Apache TVM, ncnn, PaddlePaddle, etc.

[Read-Only Mirror] Benchmarking Toolkit for Time Series Anomaly Detection Algorithms using TimeEval and GutenTAG

BenchTemp: A General Benchmark for Evaluating Temporal Graph Neural Networks

Benchmarking suite for MushroomRL Deep RL algorithms

A PyG-based package of spectral GNNs with benchmark evaluations.

It is an evaluation framework for evaluating and comparing graph embedding techniques

This codebase stores the complete artifacts and describes how to reproduce or extend the results from the paper "Style Outweighs Substance: Failure modes of LLM judges in alignment benchmarking", including the SOS-Bench meta-benchmark.

Implementation for our paper “NewTerm: Benchmarking Real-Time New Terms for Large Language Models with Annual Updates,” accepted to NeurIPS 2024 D&B. ?

A design space exploration tool for deep neural architectures