apple-silicon-4bit-quant
PublicSupporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"
Creat:2024-03-06T12:21:25
Update:2024-12-12T17:03:27
10
Stars
0
Stars Increase
Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"