Awesome-Efficient-PLM

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

The official GitHub page for the survey paper "A Survey of Large Language Models".

Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.

Must-read papers on prompt-based tuning for pre-trained language models.

Awesome Knowledge Distillation

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

[CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.

An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.

RoBERTa中文预训练模型: RoBERTa for Chinese

收集和梳理垂直领域的开源模型、数据集及评测基准。