Popular GitHub Repositories for Litserve

Chat with Phi 3.5/3 Vision LLMs. Phi-3.5-vision is a lightweight, state-of-the-art open multimodal model built upon datasets which include - synthetic data and filtered publicly available websites - with a focus on very high-quality, reasoning dense data both on text and vision.

Deploy and Chat with Llama 3.2-Vision Multimodal LLM Using LitServe, Lightning-Fast Inference Engine

基于LitServe框架的模型服务示例

Contains solutoins for assignments and learning notes from Extensive Machine Learning Operations course of The School of AI

Leverage PaliGemma 2 mix model variant capabilities using LitServe.

Leverage PaliGemma 2's DOCCI fine-tuned variant capabilities using LitServe.

This is an AI/ML Project Deployment Template, which uses Litserve & Runpod as backend service & gradio for UI.

Leverage Aya Vision's capabilities using LitServe.