Popular GitHub Repositories for Prioritized Advantage Distillation

??? 60+ Implementations/tutorials of deep learning papers with side-by-side notes ?; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ? reinforcement learning (ppo, dqn), capsnet, distillation, ... ?

Simple Reinforcement learning tutorials, 莫烦Python 中文AI教学

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

PyTorch implementation of Advantage Actor Critic (A2C), Proximal Policy Optimization (PPO), Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation (ACKTR) and Generative Adversarial Imitation Learning (GAIL).

Awesome Knowledge Distillation

Modularized Implementation of Deep RL Algorithms in PyTorch

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.

Collection of AWESOME vision-language models for vision tasks

Clean, Robust, and Unified PyTorch implementation of popular Deep Reinforcement Learning (DRL) algorithms (Q-learning, Duel DDQN, PER, C51, Noisy DQN, PPO, DDPG, TD3, SAC, ASL)

"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

Images to inference with no labeling (use foundation models to train supervised models).

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

推荐/广告/搜索领域工业界经典以及最前沿论文集合。A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search.

This is a collection of our NAS and Vision Transformer work.

A curated list for Efficient Large Language Models

PyTorch implementation of various methods for continual learning (XdG, EWC, SI, LwF, FROMP, DGR, BI-R, ER, A-GEM, iCaRL, Generative Classifier) in three different scenarios.

A curated list of awesome papers on dataset distillation and related applications.

A PyTorch-based knowledge distillation toolkit for natural language processing