Popular GitHub Repositories for Instruction Following

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

The official GitHub page for the survey paper "A Survey of Large Language Models".

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

AirLLM 70B inference with single 4GB GPU

Data processing for and with foundation models! ? ? ? ?? ??? ? ?

Repo for BenTsao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调

Aligning pretrained language models with instruction data generated by themselves.

Instruction Tuning with GPT-4

Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

【EMNLP 2024?】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

? Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

A quick guide (especially) for trending instruction finetuning datasets

总结Prompt&LLM论文，开源数据&模型，AIGC应用

OpenBot leverages smartphones as brains for low-cost robots. We have designed a small electric vehicle that costs about $50 and serves as a robot body. Our software stack for Android smartphones supports advanced robotics workloads such as person following and real-time autonomous navigation.

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding