Popular GitHub Repositories for Closed Captions

A computer vision closed-loop learning platform where code can be run interactively online. 学习闭环《计算机视觉实战演练：算法与应用》中文电子书、源码、读者交流社区（持续更新中 ...） ? 在线电子书 https://charmve.github.io/computer-vision-in-action/ ?项目主页

[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

Closed-form Continuous-time Neural Networks

A python toolkit for parsing captions (in natural language) into scene graphs (as symbolic representations).

A deep learning-powered visual navigation engine to enables autonomous navigation of pocket-size quadrotor - running on PULP

[NeurIPS 2024] CLOVER: Closed-Loop Visuomotor Control with Generative Expectation for Robotic Manipulation

Transcribe and translate audio to text using Whisper and DeepL.

? Auto Captions for Final Cut Pro Powered by OpenAI's Whisper Model

[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions

Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)

Image Captions Generation with Spatial and Channel-wise Attention

GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)

Generate TikTok-style captions with Whisper.cpp

[CVPR 2025, Spotlight] SimLingo (CarLLava): Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignment

AI-short-creator is an AI-powered tool that turns long videos into short clips. It works best for videos with multiple speakers and topics, such as interviews and documentaries. AI-short-creator finds the most engaging parts of the video, adds captions and transitions, and makes the clips ready for social media.

A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.

PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)

Closed-Loop Supervised Fine-Tuning of Tokenized Traffic Models. CVPR 2025.

Speech-to-text and keyboard input captions for OBS.

Generate realistic Instagram captions using transformers ?