embeddedllm
PublicEmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
Creat:2024-06-17T21:45:35
Update:2025-03-12T10:40:24
41
Stars
0
Stars Increase
EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU