TinyChatEngine
PublicTinyChatEngine: On-Device LLM Inference Library
armccppcuda-programmingdeep-learningedge-computinglarge-language-modelson-device-aiquantizationx86-64
Creat:2023-05-24T17:29:41
Update:2025-03-24T16:53:33
https://mit-han-lab.github.io/TinyChatEngine/
878
Stars
2
Stars Increase