Popular GitHub Repositories for Int8 Quantization

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

Your friendliest open source AI automation tool ? Workflow automation tool 200+ integration / Enterprise automation tool / Zapier Alternative

This repository offers a comprehensive collection of tutorials on state-of-the-art computer vision models and techniques. Explore everything from foundational architectures like ResNet to cutting-edge models like YOLO11, RT-DETR, SAM 2, Florence-2, PaliGemma 2, and Qwen2.5VL.

? Kubectl plugin to create manifests with LLMs

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

NanoDet-Plus?Super fast and lightweight anchor-free object detection model. ?Only 980 KB(int8) / 1.8MB (fp16) and run 97FPS on cellphone?

A MCP for Claude Desktop / Claude Code / Windsurf / Cursor to build n8n workflows for you

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Evolution API is an open-source WhatsApp integration API

Standardized Serverless ML Inference Platform on Kubernetes

? A lite C++ toolkit of 100+ Awesome AI models, support ORT, MNN, NCNN, TNN and TensorRT. ??

Fast inference engine for Transformer models

MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle

Vector (and Scalar) Quantization, in Pytorch

OpenMMLab YOLO series toolbox and benchmark. Implemented RTMDet, RTMDet-Rotated,YOLOv5, YOLOv6, YOLOv7, YOLOv8,YOLOX, PPYOLOE, etc.

Sparsity-aware deep learning inference runtime for CPUs

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

The Compute Library is a set of computer vision and machine learning functions optimised for both Arm CPUs and GPUs using SIMD technologies.