Popular GitHub Repositories for Multimodal Datasets

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, and more.

Agno is a lightweight library for building Multimodal Agents. It exposes LLMs as a unified API and gives them superpowers like memory, knowledge, tools and reasoning.

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.

?? Build multimodal AI applications with cloud-native stack

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

? The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

? Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. ?YC W23

Transfer learning / domain adaptation / domain generalization / multi-task learning etc. Papers, codes, datasets, applications, tutorials.-迁移学习

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/README.md)

pix2code: Generating Code from a Graphical User Interface Screenshot

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

Open source annotation tool for machine learning practitioners.

A powerful tool for creating fine-tuning datasets for LLM

A framework to enable multimodal models to operate a computer.

Refine high-quality datasets and visual AI models