ArtQuantization

Public

ArtQuantization is developed for quantizing Large Language Models, focusing on optimizing the memory usage and performance. This repository provides experimental results of quantizing models such as Qwen2.5 using different algorithms like AWQ and GPTQ, and demonstrates the memory requirements under various graphics card configurations.

large-language-models quantization

Creat：2025-04-28T16:11:53

Update：2025-05-17T20:43:20

Stars

Stars Increase

Related projects

Transformers

Hot

bert

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

147733

2年前

+59today

TypeScript

javascript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

105459

4个月前

+18today

Rust

compiler

Empowering everyone to build reliable and efficient software.

105427

4个月前

+34today

Generative Ai For Beginners

Hot

21 Lessons, Get Started Building with Generative AI ? https://microsoft.github.io/generative-ai-for-beginners/

93782

5个月前

+85today

Django

apps

The Web framework for perfectionists with deadlines.

84427

4个月前

+21today

D2l Zh

book

《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

71230

4个月前

+41today

Gpt_academic

academic

为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

69031

4个月前

+9today