Popular GitHub Repositories for Gpt4v

AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

Control Any Computer Using LLMs.

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.

Lightweight GPT-4 Vision processing over the Webcam

Prompts of GPT-4V & DALL-E3 to full utilize the multi-modal ability. GPT4V Prompts, DALL-E3 Prompts.

[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions

GPT-4V in Wonderland: LMMs as Smartphone Agents

Implementation of MambaByte in "MambaByte: Token-free Selective State Space Model" in Pytorch and Zeta

中文医学多模态大模型 Large Chinese Language-and-Vision Assistant for BioMedicine

Mark web pages for use with vision-language models

This repository offers a Python framework for a retrieval-augmented generation (RAG) pipeline using text and images from MHTML documents, leveraging Azure AI and OpenAI services. It includes ingestion and enrichment flows, a RAG with Vision pipeline, and evaluation tools.

Language instructions to mycobot using GPT-4V

? GPT-4V Demos • Test the model's vision capabilities in your browser using Streamlit • Easy setup

Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2

I GAVE GPT-4 EYES!

Chain of Images for Intuitively Reasoning

poc gpt-4 vision bot

Digital Artificial Intelligence Agent

Explore the rich flavors of Indian desserts with TunedLlavaDelights. Utilizing the in Llava fine-tuning, our project unveils detailed nutritional profiles, taste notes, and optimal consumption times for beloved sweets. Dive into a fusion of AI innovation and culinary tradition

ISO 13485 Sniffer Bot, GPT4V with LlamaIndex embeded in React Bot UI