Popular GitHub Repositories for Figure Captioning

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

Keras model to generate HTML code from hand-drawn website mockups. Implements an image captioning architecture to drawn source images.

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

任意内容描述的实现：详细的本地化图像和视频字幕

awesome grounding: A curated list of research papers in visual grounding

Tag manager and captioner for image datasets

TensorFlow Implementation of "Show, Attend and Tell"

OBS plugin for local speech recognition and captioning using AI

?? + ? + ? = ? Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]

:fire: :fire: :fire: A paper list of some recent Computer Vision(CV) works

Meshed-Memory Transformer for Image Captioning. CVPR 2020

Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain

Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation

An open-source tool for sequence learning in NLP built on TensorFlow.

Complete Assignments for CS231n: Convolutional Neural Networks for Visual Recognition

Implementation of "Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning"

Code for paper "Attention on Attention for Image Captioning". ICCV 2019