KIVI
Public[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
Creat:2024-02-03T01:41:32
Update:2025-03-27T00:33:34
https://arxiv.org/abs/2402.02750
313
Stars
0
Stars Increase
[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache