Popular GitHub Repositories for Roberta Tokenizer

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Unsupervised text tokenizer for Neural Network-based text generation.

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

Chinese version of GPT2 training code, using BERT tokenizer.

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

RoBERTa中文预训练模型: RoBERTa for Chinese

?️ Generate natural-sounding speech and clone voices without a tokenizer using VoxCPM's context-aware TTS. Experience true-to-life voice generation today.

The implementation of DeBERTa

Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Underthesea - Vietnamese NLP Toolkit

中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sft微调，给出三元组信息抽取微调示例。

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition

Persian NLP Toolkit

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。