Popular GitHub Repositories for Continued Pretraining

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

XLNet: Generalized Autoregressive Pretraining for Language Understanding

A large-scale 7B pretraining language model developed by BaiChuan-Inc.

General technology for enabling AI capabilities w/ LLMs and MLLMs

DeepSeek-VL: Towards Real-World Vision-Language Understanding

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

Large-scale pretraining for dialogue

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

[ACL 2024 ?] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

Unified-Modal Speech-Text Pre-Training for Spoken Language Processing

[ICLR'23 Spotlight?] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

Recent Advances in Vision and Language PreTrained Models (VL-PTMs)

EntitySeg Toolbox: Towards Open-World and High-Quality Image Segmentation

【ICLR 2024?】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment

Pretraining code for a large-scale depth-recurrent language model

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites

Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm