Popular GitHub Repositories for Reward Models

Recipes to train reward model for RLHF.

[NeurIPS 2024] ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimization

A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Alpaca architecture. Basically ChatGPT but with Alpaca

official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and Alternatives

[ICLR'24 spotlight] Tool-Augmented Reward Modeling

ZYN: Zero-Shot Reward Models with Yes-No Questions