Product Finder

Product Submit

AI Models Finder

MCP Servers

MCP Client

MCP Inspector

Case Tutorials

Latest AI News

AI Daily Brief

Compressed-Transformers

In this repository, we explore model compression for transformer architectures via quantization. We specifically explore quantization aware training of the linear layers and demonstrate the performance for 8 bits, 4 bits, 2 bits and 1 bit (binary) quantization.

deep-learning edge-ml federated-learning iwslt model-compression pytorch transformer

Creat：2020-11-07T20:28:13

Update：2025-03-19T03:34:52

24

Stars

0

Stars Increase

Related projects

Tensorflow

An Open Source Machine Learning Framework for Everyone

Stable Diffusion Webui

Stable Diffusion web UI

Transformers

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

30 Seconds Of Code

Coding articles to level up your development skills

Pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Opencv

Open Source Computer Vision Library

Netdata

X-Ray Vision for your infrastructure!

Deep Live Cam

real time face swap and one-click video deepfake with only a single image

D2l Zh

《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

Cs Video Courses

List of Computer Science courses with video lectures.