Popular GitHub Repositories for Guided Instruction

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

The official GitHub page for the survey paper "A Survey of Large Language Models".

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

Pytorch implementation of convolutional neural network visualization techniques

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.

AirLLM 70B inference with single 4GB GPU

Data processing for and with foundation models! ? ? ? ?? ??? ? ?

Repo for BenTsao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调

Aligning pretrained language models with instruction data generated by themselves.

Instruction Tuning with GPT-4

Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca

A language for constraint-guided and efficient LLM programming.

? Create Disco Diffusion artworks in one line

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

【EMNLP 2024?】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

? Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

A quick guide (especially) for trending instruction finetuning datasets