Popular GitHub Repositories for Activitynet Captions

[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

A python toolkit for parsing captions (in natural language) into scene graphs (as symbolic representations).

Transcribe and translate audio to text using Whisper and DeepL.

? Auto Captions for Final Cut Pro Powered by OpenAI's Whisper Model

[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions

Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)

[CVPR 2021] Actor-Context-Actor Relation Network for Spatio-temporal Action Localization

Image Captions Generation with Spatial and Channel-wise Attention

GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)

Generate TikTok-style captions with Whisper.cpp

A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.

AI-short-creator is an AI-powered tool that turns long videos into short clips. It works best for videos with multiple speakers and topics, such as interviews and documentaries. AI-short-creator finds the most engaging parts of the video, adds captions and transitions, and makes the clips ready for social media.

PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)

Speech-to-text and keyboard input captions for OBS.

Generate realistic Instagram captions using transformers ?

ARChat Chrome Extension for CHI 2023 Papers (Visual Captions, Text Stability)

Generate YouTube Shorts using Reddit posts scraped with PRAW, title and captions generated with GPT, images and thumbnails generated with Stable Diffusion and voiceover with 11Labs

An experimental solution to illustrate how Amazon Transcribe can be used in conjunction with Amazon IVS to deliver real-time captions for live streams.

Generate captions for videos using the power of OpenAI's Whisper API