Popular GitHub Repositories for Multihead

list of efficient attention modules

A comprehensive code for AI & Robotics.

Implementation of Siamese Neural Networks built upon multihead attention mechanism for text semantic similarity task.

Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)

A Faster Pytorch Implementation of Multi-Head Self-Attention

Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow ?, Pytorch ?, and Jax ?)

???? ??? ??? ???? ?????. (DCGAN, VAE, Resnet ??)

PyTorch Implementation of Stepwise Monotonic Multihead Attention similar to Enhancing Monotonicity for Robust Autoregressive Transformer TTS

An simple pytorch implementation of Flash MultiHead Attention

Sustain-LC is a benchmarking environment for traditional and reinforcement learning based controls as well as LLM based control

Joint text classification on multiple levels with multiple labels, using a multi-head attention mechanism to wire two prediction tasks together.

An experimental project for autonomous vehicle driving perception with steering angle prediction and semantic segmentation using a combination of UNet, attention and transformers.

Official Repository for different models based on MultiHead VGAEs.

News Articles Recommendation System. (Project for Practical Seminar in Machine Learning - PSI:ML 9)

Official implementation of the paper "FedLSF: Federated Local Graph Learning via Specformers"

Machine Translation models (with and without attention) to convert sentences in Tamil to Hindi. Transformer models are also used for this same task and performance is compared.

Variance-driven adaptive multihead CNN controller with EMA thresholds and dynamic freeze/scale regulation.