HolmesVAU

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

The official GitHub page for the survey paper "A Survey of Large Language Models".

Aligning pretrained language models with instruction data generated by themselves.

Instruction Tuning with GPT-4

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

? Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

【EMNLP 2024?】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

总结Prompt&LLM论文，开源数据&模型，AIGC应用

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions