Popular GitHub Repositories for Andrej Karpathy

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

NLP Zero to Hero in just 10 Kernels

Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch. Based on code of https://github.com/karpathy/char-rnn. Support Chinese and other things.

Jupyter Notebook notes on Andrej Karpathy's videos and the tutorial series, "Neural Networks: Zero to Hero."

Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish

This repository contains the collection of explorative notebooks pure in python and in the language that we, humans can read. Have tried to compile all lectures from the Andrej Karpathy's ? playlist on Neural Networks - which we will end up with building GPT.

? A TypeScript version of karpathy/micrograd — a tiny scalar-valued autograd engine and a neural net on top of it

Detailed python notes & code for lectures and exercises of Andrej Karpathy's course "Neural Networks: Zero to Hero." The course is focused on building neural networks from scratch.

Generating image captions using Xception Network and Beam Search in Keras - My Bachelor's thesis project

finetuning shakespeare on karpathy/nanoGPT

generate & query embeddings from VTT files using openai & pinecone on Andrej Karpathy's's latest GPT tutorial

A structured documentation hub for AI and ML concepts, based on Andrej Karpathy's 'Zero to Hero' series, featuring practical implementations and learning resources for language models and transformers.

Re-implementation of Andrej Karpathy's nanoGPT

Drawing inspiration from Andrej Karpathy’s iconic lecture, "Let’s Build GPT: From Scratch, in Code, Spelled Out", this project takes you on an immersive journey into the inner workings of GPT. Step-by-step, we’ll construct a GPT model from the ground up, demystifying its architecture and bringing its mechanics to life through hands-on coding.

understanding language modeling by training a small GPT on Shakespeare plays.

A reimplementation of Andrej Karpathy's repository for an RL self-learning AI agent that learns to play Pong through trial and error, using PyTorch

Transcripts of the Neural Networks: Zero to Hero course

Following Prof. Andrej Karpathy Makemore tutorial series on yt.

Text generation using a character-based RNN with LSTM cells. We will work with a dataset of Shakespeare's writing from Andrej Karpathy's The Unreasonable Effectiveness of Recurrent Neural Networks. Given a sequence of characters from this data ("Shakespear"), train a model to predict the next character in the sequence ("e"). Longer sequences of text can be generated by calling the model repeatedly. Developed using Keras. Inspired by the following notebook: https://colab.research.google.com/github/tensorflow/docs/blob/master/site/en/tutorials/text/text_generation.ipynb#scrollTo=BwpJ5IffzRG6

Jax/Flax re-write of @karpathy ? NanoGPT using some of the common Jax libraries/features (shmap, pallas, jmp, optax, orbax)