HomeAI Tutorial

finGPT-llama2-runpod

Public

Deploy FinGPT-MT-Llama-3-8B-LoRA on RunPod Serverless with llama.cpp + CUDA. Auto-scaling, OpenAI-compatible API, Q4_K_M quantization. Pay-per-use serverless inference.

Creat2025-11-28T16:40:06
Update2025-12-01T14:21:44
0
Stars
0
Stars Increase

Related projects