AIbase
Bibliothèque de produitsNavigation de l'outilMCP

inference-hive

Public

inference-hive is a toolkit to run distributed LLM inference on SLURM clusters. Configure a few cluster, inference server and data settings, and scale your inference workload across thousands of GPUs.

Heure de création2025-07-03T16:11:14
Heure de mise à jour2025-07-03T16:36:11
0
Stars
0
Stars Increase

Projets connexes