Popular GitHub Repositories for Bilingual Corpora

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

A collection of corpora for named entity recognition (NER) and entity recognition tasks. These annotated datasets cover a variety of languages, domains and entity types.

? A list of accessible speech corpora for ASR, TTS, and other Speech Technologies

An Open-sourced Knowledgable Large Language Model Framework.

AI Podcast Generator for bilingual episodes, Multi Languages, Alternative to NotebookLLM；真人对话AI播客生成器，多语言，多音色

Stable Diffusion web UI bilingual localization extensions. SD WebUI双语对照翻译插件

A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese

Open tools and data for cloudless automatic speech recognition

This repository contains the code, data, and models of the paper titled "XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages" published in Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021.

Official source for spanish Language Models and resources made @ BSC-TEMU within the "Plan de las Tecnologías del Lenguaje" (Plan-TL).

Toolkit to obtain and preprocess German text corpora, train models and evaluate them with generated testsets. Built with Gensim and Tensorflow.

Curated list of Ukrainian natural language processing (NLP) resources (corpora, pretrained models, libriaries, etc.)

[ACL 2024] IEPile: A Large-Scale Information Extraction Corpus

A tool that locates, downloads, and extracts machine translation corpora

An automated tool for discovering insights from research papaer corpora

Source codes and corpora of paper "Iterated Dilated Convolutions for Chinese Word Segmentation"

CrossNER: Evaluating Cross-Domain Named Entity Recognition (AAAI-2021)

Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023

UniversalRAG: Retrieval-Augmented Generation over Corpora of Diverse Modalities and Granularities

在Unity环境下，借助sherpa-ncnn框架，实现实时并准确的中英双语语音识别功能。