Popular GitHub Repositories for Conceptual Captions

[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

A python toolkit for parsing captions (in natural language) into scene graphs (as symbolic representations).

Transcribe and translate audio to text using Whisper and DeepL.

? Auto Captions for Final Cut Pro Powered by OpenAI's Whisper Model

Train a Word2Vec model or LSA model, and Implement Conceptual Search\Semantic Search in Solr\Lucene - Simon Hughes Dice.com, Dice Tech Jobs

Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)

[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions

Image Captions Generation with Spatial and Channel-wise Attention

GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)

Violet: A Vision-Language model for generating Arabic image captions using a Gemini Decoder and pretrained transformer.

Generate TikTok-style captions with Whisper.cpp

PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)

AI-short-creator is an AI-powered tool that turns long videos into short clips. It works best for videos with multiple speakers and topics, such as interviews and documentaries. AI-short-creator finds the most engaging parts of the video, adds captions and transitions, and makes the clips ready for social media.

A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.

Speech-to-text and keyboard input captions for OBS.

Generate realistic Instagram captions using transformers ?

ARChat Chrome Extension for CHI 2023 Papers (Visual Captions, Text Stability)

Generate YouTube Shorts using Reddit posts scraped with PRAW, title and captions generated with GPT, images and thumbnails generated with Stable Diffusion and voiceover with 11Labs

An experimental solution to illustrate how Amazon Transcribe can be used in conjunction with Amazon IVS to deliver real-time captions for live streams.

Generate captions for videos using the power of OpenAI's Whisper API