About

A lightweight Transformer implementation in PyTorch for experimenting with word embeddings, positional encoding, and next-word prediction. Includes a Colab notebook for step-by-step sentence generation and visualization. Ideal for learning how transformers generate text and testing tiny datasets.