worker-vllm
PublicThe RunPod worker template for serving our large language model endpoints. Powered by vLLM.
Creat:2023-07-04T02:42:36
Update:2025-03-20T23:06:44
337
Stars
0
Stars Increase
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.