Popular GitHub Repositories for Vision Language Model

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

DeepSeek-VL: Towards Real-World Vision-Language Understanding

Align Anything: Training All-modality Model with Feedback

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

Collection of AWESOME vision-language models for vision tasks

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

[CVPR 2025] Open-source, End-to-end, Vision-Language-Action model for GUI Agent & Computer Use.

[CVPR 2024 Highlight?] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

[CVPR 2024 ?] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want

Famous Vision Language Models and Their Architectures

任意内容描述的实现：详细的本地化图像和视频字幕

Parsing-free RAG supported by VLMs

VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models

An open-source implementaion for fine-tuning Qwen2-VL and Qwen2.5-VL series by Alibaba Cloud.