Popular GitHub Repositories for Progressive Distillation

??? 60+ Implementations/tutorials of deep learning papers with side-by-side notes ?; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ? reinforcement learning (ppo, dqn), capsnet, distillation, ... ?

Awesome Knowledge Distillation

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.

Collection of AWESOME vision-language models for vision tasks

"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

Images to inference with no labeling (use foundation models to train supervised models).

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

:fire: PI-REC: Progressive Image Reconstruction Network With Edge and Color Domain. :fire: 图像翻译，条件GAN，AI绘画

推荐/广告/搜索领域工业界经典以及最前沿论文集合。A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search.

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

A curated list for Efficient Large Language Models

A curated list of awesome papers on dataset distillation and related applications.

The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"

This is a collection of our NAS and Vision Transformer work.

PyTorch implementation of various methods for continual learning (XdG, EWC, SI, LwF, FROMP, DGR, BI-R, ER, A-GEM, iCaRL, Generative Classifier) in three different scenarios.

A PyTorch-based knowledge distillation toolkit for natural language processing

OpenMMLab Model Compression Toolbox and Benchmark.

PaddleSlim is an open-source library for deep model compression and architecture search.

A platform for playing generative music in the browser.