Dragon from Spencer’s Faerie Queen c. 1590 (Walter Grane 1894–1897)

You are viewing this on a mobile device, but SITP is best viewed on a desktop — the book includes various multimedia lecture videos, visualizers, any tufte-style sidenotes with many external hyperlinks to other resources.

III. Scaling Networks

5. Post Training Assistants and Reasoners
- 5.1 From The Age of Research to the Age of Scaling
- 5.2 Pre-training with nanochat
  - 5.2.1 Architecture with Transformers
  - 5.2.2 Optimization with Muon
6. The Dungeon of Tensor Compilers
7. The Thunder Clouds of Distributed

5. Post Training Assistants and Reasoners

5.1 From the Age of Research to the Age of Scaling

The Structure and Interpretation of Tensor Programs

III. Scaling Networks

Table of Contents

5. Post Training Assistants and Reasoners

5.1 From the Age of Research to the Age of Scaling

5.2 Pre-training with `nanochat`

5.2.1 Architecture with Transformers

5.2.2 Optimization with Muon

6. The Dungeon of Tensor Compilers

7. The Thunder Clouds of Distributed

Keyboard shortcuts

The Structure and Interpretation of Tensor Programs