Popular GitHub Repositories for Gnn Pretraining

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

XLNet: Generalized Autoregressive Pretraining for Language Understanding

A large-scale 7B pretraining language model developed by BaiChuan-Inc.

General technology for enabling AI capabilities w/ LLMs and MLLMs

Recommendation Algorithm大规模推荐算法库，包含推荐系统经典及最新算法LR、Wide&Deep、DSSM、TDM、MIND、Word2Vec、Bert4Rec、DeepWalk、SSR、AITM，DSIN，SIGN，IPREC、GRU4Rec、Youtube_dnn、NCF、GNN、FM、FFM、DeepFM、DCN、DIN、DIEN、DLRM、MMOE、PLE、ESMM、ESCMM, MAML、xDeepFM、DeepFEFM、NFM、AFM、RALM、DMR、GateNet、NAML、DIFM、Deep Crossing、PNN、BST、AutoInt、FGCNN、FLEN、Fibinet、ListWise、DeepRec、ENSFM，TiSAS，AutoFIS等，包含经典推荐系统数据集criteo 、movielens等

DeepSeek-VL: Towards Real-World Vision-Language Understanding

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

AI Roadmap:机器学习(Machine Learning)、深度学习(Deep Learning)、对抗神经网络(GAN），图神经网络（GNN），NLP，大数据相关的发展路书(roadmap), 并附海量源码（python，pytorch）带大家消化基本知识点，突破面试，完成从新手到合格工程师的跨越，其中深度学习相关论文附有tensorflow caffe官方源码，应用部分含推荐算法和知识图谱

PyTorch Geometric Temporal: Spatiotemporal Signal Processing with Neural Machine Learning Models (CIKM 2021)

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

Large-scale pretraining for dialogue

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2023)

Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

[ACL 2024 ?] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

Unified-Modal Speech-Text Pre-Training for Spoken Language Processing

[ICLR'23 Spotlight?] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

An Industrial Graph Neural Network Framework

A PyTorch implementation of "Capsule Graph Neural Network" (ICLR 2019).