Popular GitHub Repositories for Gmlp

Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch

My implementation of the gMLP model from the paper "Pay Attention to MLPs".

An implementation of gated MLPs in tinygrad, as an alternative to transformers.

Model performance and tuning analysis conducted on the CIFAR10 and CIFAR100 datasets. Convolutional Neural Network (CNN), Gated Multilayer Perceptron (gMLP), and Vision Transformer (ViT) model architectures are utilized. The study is built using PyTorch, PyTorch Lightning, and Optuna. MLflow, DVC, YAML files and the Hydra framework are used.