Popular GitHub Repositories for Cross Modal

? Light and Fast AI Assistant. Support: Web | iOS | MacOS | Android | Linux | Windows

Cross-platform, customizable ML solutions for live and streaming media.

基于 ChatGPT API 的划词翻译浏览器插件和跨平台桌面端应用 - Browser extension and cross-platform desktop application for translation based on ChatGPT API.

MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Awesome pre-trained models toolkit based on PaddlePaddle. (400+ models including Image, Text, Audio, Video and Cross-Modal with Easy Inference & Serving)

? Scalable embedding, reasoning, ranking for images and sentences with CLIP

Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

An open source implementation of CLIP.

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

? Next Generation AI One-Stop Internationalization Solution. ? 下一代 AI 一站式 B/C 端解决方案，支持 OpenAI，Midjourney，Claude，讯飞星火，Stable Diffusion，DALL·E，ChatGLM，通义千问，腾讯混元，360 智脑，百川 AI，火山方舟，新必应，Gemini，Moonshot 等模型，支持对话分享，自定义预设，云端同步，模型市场，支持弹性计费和订阅计划模式，支持图片解析，支持联网搜索，支持模型缓存，丰富美观的后台管理与仪表盘数据统计。

ModelScope: bring the notion of Model-as-a-Service to life.

The world’s first real-time, distributed, cloud-edge collaborative multimodal AI Agent Framework that simultaneously supports C/C++/Go/Python/JS/TS

a state-of-the-art-level open visual language model | 多模态预训练模型

Multilingual Voice Understanding Model

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.