vector-inference
PublicEfficient LLM inference on Slurm clusters using vLLM.
Creat:2024-03-06T09:36:48
Update:2025-03-25T04:11:32
https://vectorinstitute.github.io/vector-inference/
69
Stars
0
Stars Increase
Efficient LLM inference on Slurm clusters using vLLM.