Popular GitHub Repositories for Cross Modal Pretraining

? Light and Fast AI Assistant. Support: Web | iOS | MacOS | Android | Linux | Windows

Cross-platform, customizable ML solutions for live and streaming media.

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

基于 ChatGPT API 的划词翻译浏览器插件和跨平台桌面端应用 - Browser extension and cross-platform desktop application for translation based on ChatGPT API.

MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

Awesome pre-trained models toolkit based on PaddlePaddle. (400+ models including Image, Text, Audio, Video and Cross-Modal with Easy Inference & Serving)

? Scalable embedding, reasoning, ranking for images and sentences with CLIP

Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

An open source implementation of CLIP.

Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

? Next Generation AI One-Stop Internationalization Solution. ? 下一代 AI 一站式 B/C 端解决方案，支持 OpenAI，Midjourney，Claude，讯飞星火，Stable Diffusion，DALL·E，ChatGLM，通义千问，腾讯混元，360 智脑，百川 AI，火山方舟，新必应，Gemini，Moonshot 等模型，支持对话分享，自定义预设，云端同步，模型市场，支持弹性计费和订阅计划模式，支持图片解析，支持联网搜索，支持模型缓存，丰富美观的后台管理与仪表盘数据统计。

ModelScope: bring the notion of Model-as-a-Service to life.

The world’s first real-time, distributed, cloud-edge collaborative multimodal AI Agent Framework that simultaneously supports C/C++/Go/Python/JS/TS

a state-of-the-art-level open visual language model | 多模态预训练模型

Multilingual Voice Understanding Model