Level 6: Architecture of Generative AI
From Tokens, Attention, and QKV to Self-Attention,
Transformer, and RAG…
Math & Python Textbook Series 10
“Curiosity about mathematics,
the foundation of everything in the AI era.”
Two free downloadable files : Hands-On Data Analysis with Python
Efficient learning with Colab note files linked to this book.
Beginner-friendly Python code explained step-by-step.
FilesStart Instantly in Your Browser—No Setup!
Contents:
Chapter 1 What Is a Generative AI System?
Chapter 2 What Is a Token? Splitting Text into Small Units
Chapter 3 Adding Positional Information: Representing Order with Math
Chapter 4 An Introduction to Attention: Representing Where to Focus as Numbers
Chapter 5 Query, Key, and Value: The Core Structure of Attention
Chapter 6 Self-Attention: Words Attending to One Another in a Sentence
Chapter 7 Multi-Head Attention: Reading with Several Views
Chapter 8 The Transformer Block: Combining Two Layers
Chapter 9 Language Model Basics: Predicting the Next Token
Chapter 10 Tuning Generation: Temperature, Top-k, Top-p
Chapter 11 Viewing Prompts Mathematically: Input and Context Design
Chapter 12 The Basics of RAG: AI That Searches Before Answering
Chapter 13 Chunking and Search Accuracy: How to Cut Information
Chapter 14 AI Errors and Hallucination: Probability vs Fact
Chapter 15 An Introduction to AI Agents: Judging and Using Tools
Chapter 16 Comprehensive Project: Building a Small RAG-Style AI System
Appendix A Mini-Glossary of Math Used in Generative AI
Appendix B Mini-Glossary of Transformer Terms
Appendix C Mini-Glossary of RAG and AI-System Terms
Purchase site (English version)：Some sites only offer the digital version.
US (United States)