Popular GitHub Repositories for Interpretable Bidirectional Attention

??? 60+ Implementations/tutorials of deep learning papers with side-by-side notes ?; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ? reinforcement learning (ppo, dqn), capsnet, distillation, ... ?

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Machine learning, in numpy

Natural Language Processing Tutorial for Deep Learning Researchers

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.

A PyTorch implementation of the Transformer model in "Attention is All You Need".

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

Fit interpretable models. Explain blackbox machine learning.

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

A concise but complete full-attention transformer with a set of promising experimental features from various papers

Official PyTorch implementation of PTS/PSRN: Fast and efficient symbolic expression discovery through parallelized tree search. Evaluates millions of expressions simultaneously on GPU with automated subtree reuse.

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites