Popular GitHub Repositories for Lmm

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.

[CVPR 2024 ?] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR2024]

A RLHF Infrastructure for Vision-Language Models

An open-source cloud-native of large multi-modal models (LMMs) serving framework.

? curated list of awesome LMM hallucinations papers, methods & resources.

??? Yo'LLaVA: Your Personalized Language and Vision Assistant

Multimodal chatbot with computer vision capabilities integrated, our 1st-gen LMM

[CVPR 2025 ?]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos

[COLING 2025] Idea23D: Collaborative LMM Agents Enable 3D Model Generation from Interleaved Multimodal Inputs

LLaVA inference with multiple images at once for cross-image analysis.

Official implementation of "Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodology"

[WACV 2025] LatteCLIP: Unsupervised CLIP Fine-Tuning via LMM-Synthetic Texts

Use Gemini to auto-label images for use with Autodistill.

Foundation Models and Biometrics: A Survey and Outlook

Novel approach that leverages LVLMs to efficiently generate high-quality synthetic VQA-NLE datasets.

Foundation Models and Biometrics: A Survey and Outlook

A curated list of research papers, models, and resources related to R1-style reasoning models following DeepSeek-R1's breakthrough in January 2025.