Popular GitHub Repositories for Bitext

A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB team.

A corpus that can be used to train English-to-Italian End-to-End Speech-to-Text Machine Translation models

A library to calculate similarity scores between two collections of text sequences encoded using transformer models for bitext mining, dense retrieval, retrieval-based classification, and retrieval-augmented generation (RAG).