Popular GitHub Repositories for Reward Modeling

[ICLR 2025] IterComp: Iterative Composition-Aware Feedback Learning from Model Gallery for Text-to-Image Generation

Efficient LLM inference on Slurm clusters using vLLM.

official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and Alternatives

[CVPR 2025] Science-T2I: Addressing Scientific Illusions in Image Synthesis

Learning to route instances for Human vs AI Feedback

[ACL2024 Findings]DMoERM: Recipes of Mixture-of-Experts for Effective Reward Modeling

The code used in the paper "DogeRM: Equipping Reward Models with Domain Knowledge through Model Merging"

Building an LLM with RLHF involves fine-tuning using human-labeled preferences. Based on Learning to Summarize from Human Feedback, it uses supervised learning, reward modeling, and PPO to improve response quality and alignment.