Popular GitHub Repositories for Rlhf

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

The official GitHub page for the survey paper "A Survey of Large Language Models".

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

Robust recipes to align language models with human and AI preferences

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Align Anything: Training All-modality Model with Feedback

A curated list of reinforcement learning with human feedback resources (continually updated)

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。

The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

?? NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

WebGLM: An Efficient Web-enhanced Question Answering System (KDD 2023)