HomeAI Tutorial

llm-compressor

Public

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Creat2024-06-21T04:13:34
Update2025-03-27T04:04:52
2.4K
Stars
14
Stars Increase

Related projects