Awesome-Knowledge-Distillation-of-LLMs
PublicThis repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
alignmentcompressiondata-augmentationdata-synthesisfeedbackinstruction-followingkdknowledge-distillationlarge-language-modelllm
Creat:2024-02-09T00:04:45
Update:2025-03-27T08:45:39
1.1K
Stars
5
Stars Increase