Popular GitHub Repositories for Glue

Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard

A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. ?25 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. ? Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.

Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)

??The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).

Semantics-aware BERT for Language Understanding (AAAI 2020)

pytorch implementation for Patient Knowledge Distillation for BERT Model Compression

ALBERT model Pretraining and Fine Tuning using TF2.0

Datasets collection and preprocessings framework for NLP extreme multitask learning

Implementation of XLNet that can load pretrained checkpoints

A generalized framework for subspace tuning methods in parameter efficient fine-tuning.

This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.12410).

IndoLEM is a comprehensive Indonesian NLU benchmark, comprising three pillars NLP task: morpho-syntax, semantic, and discourse. Presented in COLING 2020.

CLUE baseline pytorch CLUE的pytorch版本基线

MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices

基于bert4keras的GLUE基准代码

Code for the paper "PALBERT: Teaching ALBERT to Ponder", NeurIPS 2022 Spotlight

Discourse Based Evaluation of Language Understanding

GLUE is a lightweight, Python-based collection of scripts to support you at succeeding with speech and text use-cases based on Microsoft Azure Cognitive Services.

In MT-BERT we reproduce a neural language understanding model which implements a Multi-Task Deep Neural Network (MT-DNN) for learning representations across multiple NLU tasks.

Cloud-based AI / ML workflow and data application development framework