openmodelz
PublicAutoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
Creat:2023-07-13T22:50:20
Update:2025-03-22T07:51:08
https://docs.open.modelz.ai
270
Stars
0
Stars Increase
Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)