Level 6: Architecture of Generative AI
From Tokens, Attention, and QKV to Self-Attention,
Transformer, and RAG…
Math & Python Textbook Series 10
“Curiosity about mathematics,
the foundation of everything in the AI era.”
Two free downloadable files : Hands-On Data Analysis with Python
Efficient learning with Colab note files linked to this book.
Beginner-friendly Python code explained step-by-step.
FilesStart Instantly in Your Browser—No Setup!
Contents:
Chapter 1 What Is a Generative AI System?
Chapter 2 What Is a Token? Splitting Text into Small Units
Chapter 3 Adding Positional Information: Representing Order with Math
Chapter 4 An Introduction to Attention: Representing Where to Focus as Numbers
Chapter 5 Query, Key, and Value: The Core Structure of Attention
Chapter 6 Self-Attention: Words Attending to One Another in a Sentence
Chapter 7 Multi-Head Attention: Reading with Several Views
Chapter 8 The Transformer Block: Combining Two Layers
Chapter 9 Language Model Basics: Predicting the Next Token
Chapter 10 Tuning Generation: Temperature, Top-k, Top-p
Chapter 11 Viewing Prompts Mathematically: Input and Context Design
Chapter 12 The Basics of RAG: AI That Searches Before Answering
Chapter 13 Chunking and Search Accuracy: How to Cut Information
Chapter 14 AI Errors and Hallucination: Probability vs Fact
Chapter 15 An Introduction to AI Agents: Judging and Using Tools
Chapter 16 Comprehensive Project: Building a Small RAG-Style AI System
Appendix A Mini-Glossary of Math Used in Generative AI
Appendix B Mini-Glossary of Transformer Terms
Appendix C Mini-Glossary of RAG and AI-System Terms
Purchase site (English version)：Some sites only offer the digital version.
US (United States)
UK (United Kingdom)
DE (Deutschland)
FR (France)
ES (Spain)
IT (Italy)
NL (Nederland)
JP (Japan)
BR (Brasil)
CA (Canada)
MX (Mexico)
AU (Australia)
IN (India)