Part 3 in the "LLMs from Scratch" series - a complete guide to understanding and building Large Language Models. If you are interested in learning more about how these models work I encourage you to read: The paper "Attention is All You Need" debuted perhaps the single largest advancement in Natural Language Processing (NLP) in the last 10 years: the Transformer [1]. This architecture massively simplified the complex designs of language models at the time while achieving unparalleled results.