Popular GitHub Repositories for Blip

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

Image to prompt with BLIP and CLIP

Famous Vision Language Models and Their Architectures

?? + ? + ? = ? Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]

Chain together LLMs for reasoning & orchestrate multiple large models for accomplishing complex tasks

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP-2, and many more!

[ICRA 2024] Chat with NeRF enables users to interact with a NeRF model by typing in natural language.

A most Frontend Collection and survey of vision-language model papers, and models GitHub repository

(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions

This repository provides an interactive image colorization tool that leverages Stable Diffusion (SDXL) and BLIP for user-controlled color generation. With a retrained model using the ControlNet approach, users can upload images and specify colors for different objects, enhancing the colorization process through a user-friendly Gradio interface.

Automate Fashion Image Captioning using BLIP-2. Automatic generating descriptions of clothes on shopping websites, which can help customers without fashion knowledge to better understand the features (attributes, style, functionality etc.) of the items and increase online sales by enticing more customers.

Implementation of Qformer from BLIP2 in Zeta Lego blocks.

A demo of fine tune Stable Diffusion on Pokemon-Blip-Captions in English, Japanese and Chinese Corpus

[ACM MM 2024] Improving Composed Image Retrieval via Contrastive Learning with Scaling Positives and Negatives

An offline AI-powered video analysis tool with object detection (YOLO), image captioning (BLIP), speech transcription (Whisper), audio event detection (PANNs), and AI-generated summaries (LLMs via Ollama). It ensures privacy and offline use with a user-friendly GUI.

Convierte tus fotografías en poemas usando BLIP + GPT-4

SAM + CLIP + DIFFUSION for image to edit objects in images using plain text

oCaption: Leveraging OpenAI's GPT-4 Vision for Advanced Image Captioning

Learn to use deep learning models such as transformer, mamba, stable diffusion, clip, blip, dinov2, expert systems, etc

This repository is for profiling, extracting, visualizing and reusing generative AI weights to hopefully build more accurate AI models and audit/scan weights at rest to identify knowledge domains for risk(s).