Popular GitHub Repositories for Corpus Linguistics

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

A collection of small corpuses of interesting data for the creation of bots and similar stuff.

The Abstraction and Reasoning Corpus

搜索所有中文NLP数据集，附常用英文NLP数据集

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

Deep Learning and deep reinforcement learning research papers and some codes

Awesome Chatbot Projects,Corpus,Papers,Tutorials.Chinese Chatbot =>:

用于训练中英文对话系统的语料库 Datasets for Training Chatbot System

Deep Learning model to analyze a large corpus of clear text passwords.

Learn Japanese grammar with TypeScript

Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard

A large annotated semantic parsing corpus for developing natural language interfaces.

A multilingual dialog corpus

An implement of the paper of EDA for Chinese corpus.中文语料的EDA数据增强工具。NLP数据增强。论文阅读笔记。

Human ChatGPT Comparison Corpus (HC3), Detectors, and more! ?

Curated List: Practical Natural Language Processing done in Ruby

Thai natural language processing in Python

:helicopter: 保险行业语料库，聊天机器人

Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料