X-VLM

A one stop repository for generative AI research updates, interview resources, notebooks and much more!

A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun

Collecting awesome papers of RAG for AIGC. We propose a taxonomy of RAG foundations, enhancements, and applications in paper "Retrieval-Augmented Generation for AI-Generated Content: A Survey".

Multimodal-GPT

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

Recent Advances in Vision and Language PreTrained Models (VL-PTMs)

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

A Comparative Framework for Multimodal Recommender Systems

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.