HexGen
Public[ICML 2024] Serving LLMs on heterogeneous decentralized clusters.
decentralizeddeep-learninggenerative-inferenceheterogeneouslarge-language-modelsllama2machine-learningmodel-serving
Creat:2023-11-30T19:17:54
Update:2025-03-26T02:43:46
27
Stars
0
Stars Increase