Popular GitHub Repositories for Teacher Forcing

Awesome Knowledge Distillation

[CVPR2023 Highlight] Consistent-Teacher: Towards Reducing Inconsistent Pseudo-targets in Semi-supervised Object Detection

Student–Teacher Anomaly Detection with Discriminative Latent Embeddings

Diffusion and Mutual Information-Based Target Speaker SVS by Learning from Singing Teacher

Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signals. WSDM 2021.

Code for the CVPR 2020 paper "A Multi-task Mean Teacher for Semi-supervised Shadow Detection"

Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddings

An official implementation of ICML 2022 paper "Learning Domain Adaptive Object Detection with Probabilistic Teacher"."

This is the code to the WACV 2023 paper "Asymmetric Student-Teacher Networks for Industrial Anomaly Detection" by Marco Rudolph, Tom Wehrbein, Bodo Rosenhahn and Bastian Wandt.

Knowledge Distillation with Adversarial Samples Supporting Decision Boundary (AAAI 2019)

This repository stores the files used for my summer internship's work on "teacher-student learning", an experimental method for training deep neural networks using a trained teacher model.

The basic idea is to utilize a U-Net, modified perceptual loss (pearson instead of MAE), learned basis functions, and "mean teacher" training in order to synthesize images of high quality without the normal troubles of training a GAN.

Distilling Task-Specific Knowledge from Teacher Model into BiLSTM

[CVPR'2024] Adaptive Teacher-Student Collaboration for Text-Conditional Diffusion Models

[ECML-PKDD 2023] Train Your Own GNN Teacher: Graph-Aware Distillation on Textual Graphs

[NeurIPS 2021] "G-PATE: Scalable Differentially Private Data Generator via Private Aggregation of Teacher Discriminators" by Yunhui Long*, Boxin Wang*, Zhuolin Yang, Bhavya Kailkhura, Aston Zhang, Carl A. Gunter, Bo Li

Extract handwritten information like name, student ID and then recognize them with CRNN-CTC-Attention. Using lexicon search on class list to help teacher on updating score faster

It's All In the Teacher: Zero-Shot Quantization Brought Closer to the Teacher [CVPR 2022 Oral]

The Prompt Teacher is an interactive and educational prompt engineering interface for LLMs that teaches users how to craft ??, refine ?, and optimize ? prompts to achieve the most effective and targeted responses from LLMs.

Fine-tuned BERT on SQuAd 2.0 Dataset. Applied Knowledge Distillation (KD) and fine-tuned DistilBERT (student) using BERT as the teacher model. Reduced the size of the original BERT by 40%.