Popular GitHub Repositories for Momentum

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

This code accompanies the the paper Trading with the Momentum Transformer: An Intelligent and Interpretable Architecture (https://arxiv.org/pdf/2112.08534.pdf).

?This repo contains detailed notes and multiple projects implemented in Python related to AI and Finance. Follow the blog here: https://purvasingh.medium.com

Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch

Unofficial implementation with pytorch DistributedDataParallel for "MoCo: Momentum Contrast for Unsupervised Visual Representation Learning"

Toy implementations of some popular ML optimizers using Python/JAX

Somewhat janky implementation of Sonar Sampling (momentum based sampling) for ComfyUI along with an assortment of advanced noise tools (schedule noise types, composite and a lot more!)

A collection of various gradient descent algorithms implemented in Python from scratch

A compressed adaptive optimizer for training large-scale deep learning models using PyTorch

Distributed Momentum for Byzantine-resilient Stochastic Gradient Descent (ICLR 2021)

A project that tries to influence buying and selling of stocks using an algorithmic model built using an ensemble of KNN, Decision Tree, Random forest and SVM. The model depicts an ideal scenario for maximizing profits from a trade. A momentum strategy that is used to predict trading signal has been modelled based on a set of rules using various technical indicators

Simple MATLAB toolbox for deep learning network: Version 1.0.3

codes for TGRS paper: Deep Unsupervised Embedding for Remotely Sensed Images Based on Spatially Augmented Momentum Contrast

This is the code for paper “accelerating communication-efficient federated multi-task learning with personalization and Fairness”. Besides, we compared them with other accelerated methods: FedMom FedNAG FedAdam DOMO FastSlowMo Mime, FedMoS, FedGLOMO

Tutorials for using BRIE

Implementation of the algorithms described in the papers "ZO-AdaMM: Zeroth Order Adaptive Momentum" by Chen et al., "Stochastic first- and zeroth-order methods" by Ghadimi et al. and "SignSGD via zeroth- order oracle" by Liu et al.

Momentum is an AI-powered platform that helps job seekers succeed by offering personalized tools for resume building ??, cover letter crafting ?, and interview prep ?. With AI ?, it provides tailored advice ?, real-time feedback ??, and strategic insights ? to help users stand out. ??

MNIST Handwritten Digits Classification using 3 Layer Neural Net 98.7% Accuracy

Gradient_descent_Complete_In_Depth_for beginners

"Simulations for the paper 'A Review Article On Gradient Descent Optimization Algorithms' by Sebastian Roeder"