AIbase
Product LibraryTool NavigationMCP

inference-hive

Public

inference-hive is a toolkit to run distributed LLM inference on SLURM clusters. Configure a few cluster, inference server and data settings, and scale your inference workload across thousands of GPUs.

Creat2025-07-03T16:11:14
Update2025-07-03T16:36:11
0
Stars
0
Stars Increase

Related projects