Popular GitHub Repositories for Cross Modality Translation

? Light and Fast AI Assistant. Support: Web | iOS | MacOS | Android | Linux | Windows

Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 80+ languages.

Cross-platform, customizable ML solutions for live and streaming media.

PDF scientific paper translation with preserved formats - 基于 AI 完整保留排版的 PDF 文档全文双语翻译，支持 Google/DeepL/Ollama/OpenAI 等服务，提供 CLI/GUI/Docker/Zotero

Image-to-Image Translation in PyTorch

基于 ChatGPT API 的划词翻译浏览器插件和跨平台桌面端应用 - Browser extension and cross-platform desktop application for translation based on ChatGPT API.

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

Netflix-level subtitle cutting, translation, alignment, and even dubbing - one-click fully automated AI video subtitle team | Netflix级字幕切割、翻译、对齐、甚至加上配音，一键全自动视频搬运AI字幕组

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

Free and Open Source Machine Translation API. Self-hosted, offline capable and easy to setup.

Awesome pre-trained models toolkit based on PaddlePaddle. (400+ models including Image, Text, Audio, Video and Cross-Modal with Easy Inference & Serving)

? Scalable embedding, reasoning, ranking for images and sentences with CLIP