Popular GitHub Repositories for Lvlm

[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

??? A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

[Fully open] [Encoder-free MLLM] Vision as LoRA

OpenThinkIMG is an end-to-end open-source framework that empowers LVLMs to think with images.

[NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources

? Paper list on decoding methods for LLMs and LVLMs

CLIP-MoE: Mixture of Experts for CLIP

[AAAI 2025] HiRED strategically drops visual tokens in the image encoding stage to improve inference efficiency for High-Resolution Vision-Language Models (e.g., LLaVA-Next) under a fixed token budget.

Latest Advances on (RL based) Multimodal Reasoning in Multimodal Large Language Models

The official repository of "SmartAgent: Chain-of-User-Thought for Embodied Personalized Agent in Cyber World".

LEMMA: An effective and explainable way to detect multimodal misinformation with LVLM and external knowledge augmentation, incorporating the intuition and reasoning capbility inside LVLM.

Large Visual Language Model(LVLM), Large Language Model(LLM), Multimodal Large Language Model(MLLM), Alignment, Agent, AI System, Survey

[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

?Curated list about reasoning abilitiy of MLLM, including OpenAI o1, OpenAI o3-mini, and Slow-Thinking.

Novel approach that leverages LVLMs to efficiently generate high-quality synthetic VQA-NLE datasets.

Code release for THRONE, a CVPR 2024 paper on measuring object hallucinations in LVLM generated text.