xmodal-vit

An open source implementation of CLIP.

Awesome Knowledge Distillation

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

Collection of AWESOME vision-language models for vision tasks

"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

This is a collection of our NAS and Vision Transformer work.

A curated list for Efficient Large Language Models

OpenMMLab Model Compression Toolbox and Benchmark.

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration