large-model-proxy
PublicRun multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on different ports and loading/unloading them on demand
Creat:2024-07-21T12:42:49
Update:2025-03-25T08:26:34
https://t.me/large_model_proxy
67
Stars
0
Stars Increase