HomeAI Tutorial

sample-genai-on-eks-starter-kit

Public

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: ? AI Gateway (LiteLLM) ? LLM Serving (vLLM, SGLang, Ollama) ? Vector Databases, ? Embedding Models (TEI) ? Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes

Creat2025-07-04T13:23:42
Update2025-10-11T11:39:50
28
Stars
0
Stars Increase

Related projects