Popular GitHub Repositories for Cross Modality

? Light and Fast AI Assistant. Support: Web | iOS | MacOS | Android | Linux | Windows

Cross-platform, customizable ML solutions for live and streaming media.

基于 ChatGPT API 的划词翻译浏览器插件和跨平台桌面端应用 - Browser extension and cross-platform desktop application for translation based on ChatGPT API.

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Awesome pre-trained models toolkit based on PaddlePaddle. (400+ models including Image, Text, Audio, Video and Cross-Modal with Easy Inference & Serving)

? Scalable embedding, reasoning, ranking for images and sentences with CLIP

Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

? Next Generation AI One-Stop Internationalization Solution. ? 下一代 AI 一站式 B/C 端解决方案，支持 OpenAI，Midjourney，Claude，讯飞星火，Stable Diffusion，DALL·E，ChatGLM，通义千问，腾讯混元，360 智脑，百川 AI，火山方舟，新必应，Gemini，Moonshot 等模型，支持对话分享，自定义预设，云端同步，模型市场，支持弹性计费和订阅计划模式，支持图片解析，支持联网搜索，支持模型缓存，丰富美观的后台管理与仪表盘数据统计。

The world’s first real-time, distributed, cloud-edge collaborative multimodal AI Agent Framework that simultaneously supports C/C++/Go/Python/JS/TS

a state-of-the-art-level open visual language model | 多模态预训练模型

Multilingual Voice Understanding Model

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

Cross-platform chatbot framework made with love

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

Samples for ML.NET, an open source and cross-platform machine learning framework for .NET.

Torchreid: Deep learning person re-identification in PyTorch.