Popular GitHub Repositories for Visual Modalities

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

? Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other building blocks

Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, and serves as the foundation for multiple commercial products.

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

CVPR 2025 论文和开源项目合集

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

Drench yourself in Deep Learning, Reinforcement Learning, Machine Learning, Computer Vision, and NLP by learning from these exciting lectures!!

A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.

Refine high-quality datasets and visual AI models

Learning Convolutional Neural Networks with Interactive Visualization.

[NeurIPS 2024 Best Paper][GPT beats diffusion?] [scaling laws in visual generation?] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

a state-of-the-art-level open visual language model | 多模态预训练模型

An 11-Lesson course teaching everything you need to know about harnessing GitHub Copilot as an AI Paired Programming resource.

Solve Visual Understanding with Reinforced VLMs

Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

Visual Object Tagging Tool: An electron app for building end to end Object Detection Models from Images and Videos.

Visual analysis and diagnostic tools to facilitate machine learning model selection.