Building Andrej Karpathy's Makemore from scratch
-
Updated
Jan 18, 2023 - Jupyter Notebook
Building Andrej Karpathy's Makemore from scratch
Following Prof. Andrej Karpathy Makemore tutorial series on yt.
I will be starting and completing Andrej Karpathy's "Neural Networks: Zero to Hero" YouTube playlist. This repository will contain my implementations and notes as I progress through the series.
Implimention of makemore from scratch| LLM internals- tokenization , embeddings, next-word-prediction |Refrence- Andrej Karpathy
Implementation and experiments on Neural Networks . This repository explores the fundamentals of deep learning — including forward and backward propagation, optimization, and model training — built from scratch to deepen understanding of core neural network mechanics.
Part 1: bigram language model from Andrej Karpathy makemore (Jupyter)
📖 A self-contained course to learn the basics of neural networks: from backprop to GPT! 🌻
Neural Networks: zero to hero
Implementation of a Multigram Predictor with block context multiple character-level language model for understanding next character prediction algorithms
Implementation of a Bigram Predictor single character-level language model for understanding next character prediction algorithms
Does a position embedding help a character-level Bengio MLP? Experimental study with parameter-matched controls and a context-length sweep.
To associate your repository with the makemore topic, visit your repo's landing page and select "manage topics."