Popular GitHub Repositories for Adam Optimizer

??? 60+ Implementations/tutorials of deep learning papers with side-by-side notes ?; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ? reinforcement learning (ppo, dqn), capsnet, distillation, ... ?

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

AdalFlow: The library to build & auto-optimize LLM applications.

torch-optimizer -- collection of optimizers for Pytorch

? Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

A PyTorch Toolbox for Face Recognition

Adlik: Toolkit for Accelerating Deep Learning Inference

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793

Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers advanced quantization and compression tools for deploying state-of-the-art neural networks.

Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers advanced quantization and compression tools for deploying state-of-the-art neural networks.

Visualize Tensorflow's optimizers.

Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.

Awesome-LLM-Prompt-Optimization: a curated list of advanced prompt optimization and tuning methods in Large Language Models

ADAM - A Question Answering System. Inspired from IBM Watson

Deep learning library in plain Numpy.

This is a repo for my master thesis research about the Fusion of Visual SLAM and GPS. It contains the research paper, code and other interesting data.

syftr is an agent optimizer that helps you find the best agentic workflows for your budget.

A very fast, very minimal prompt optimizer

Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch