tvm-quantization

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Universal LLM Deployment Engine with ML Compilation

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

Open deep learning compiler stack for cpu, gpu and specialized accelerators

Lossy PNG compressor — pngquant command based on libimagequant library

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.

Sparsity-aware deep learning inference runtime for CPUs

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks