Chapter 7: What is Tokenization?

Kapitel in diesem Buch

1. Frontmatter i
2. Contents vii
3. Preface xxvii
4. About the Contributor xxxiii
5. Chapter 1: The Generative AI Landscape 1
6. Chapter 2: Prompt Engineering (1) 85
7. Chapter 3: Prompt Engineering (2) 185
8. Chapter 4: Well-Known LLMs and APIs 283
9. Chapter 5: Fine-Tuning LLMs (1) 389
10. Chapter 6: LLMs and Fine-Tuning (2) 491
11. Chapter 7: What is Tokenization? 605
12. Chapter 8: Attention Mechanism 679
13. Chapter 9: LLMs and Quantization (1) 743
14. Chapter 10: LLMs and Quantization (2) 877
15. Index 999