Popular GitHub Repositories for Parallel Corpus

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

A hyperparameter optimization framework

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

A collection of small corpuses of interesting data for the creation of bots and similar stuff.

The Abstraction and Reasoning Corpus

搜索所有中文NLP数据集，附常用英文NLP数据集

Massively Parallel Deep Reinforcement Learning. ?

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

:stuck_out_tongue_closed_eyes: TensorFlowTTS: Real-Time State-of-the-art Speech Synthesis for Tensorflow 2 (supported including English, French, Korean, Chinese, German and Easy to adapt for other languages)

Fast inference engine for Transformer models

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

Deep Learning and deep reinforcement learning research papers and some codes

Massively parallel rigidbody physics simulation on accelerator hardware.

MuseV: Infinite-length and High Fidelity Virtual Human Video Generation with Visual Conditioned Parallel Denoising

Awesome Chatbot Projects,Corpus,Papers,Tutorials.Chinese Chatbot =>:

用于训练中英文对话系统的语料库 Datasets for Training Chatbot System