Popular GitHub Repositories for Cross Modal

? Create Disco Diffusion artworks in one line

A curated list of different papers and datasets in various areas of audio-visual processing

Analyze the unstructured data with Towhee, such as reverse image search, reverse video search, audio classification, question and answer systems, molecular search, etc.

Remote Sensing Sar-Optical Land-use Classfication Pytorch Pytorch高分辨率遥感语义分割/地物分割/地物分类

[CVPR 2023] Referring Image Matting

[NAACL 2022]Mobile Text-to-Image search powered by multimodal semantic representation models(e.g., OpenAI's CLIP)

DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation (ICCV 2023)

Unofficial Implementation of Google Deepmind's paper `Objects that Sound`

This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have been cited and discussed in the survey just accepted https://dl.acm.org/doi/abs/10.1145/3617833 .

Unleash the Potential of Image Branch for Cross-modal 3D Object Detection [NeurIPS2023]

[Paper][AAAI 2023] DUET: Cross-modal Semantic Grounding for Contrastive Zero-shot Learning

The implementation of AAAI-17 paper "Collective Deep Quantization of Efficient Cross-modal Retrieval"

Code for paper "direct speech-to-image translation"

X-MIC: Cross-Modal Instance Conditioning for Egocentric Action Generalization, CVPR 2024

cDCGAN model for audio-to-image generation: a cross-modal analysis using deep-learning techniques