Structure and Interpretation
of Tensor Programs
First Edition
A Whirlwind Tour to Deep Learning and Deep Learning Systems
Runnanochatby buildingteenygradfrom scratch: the bridge from microgradto tinygrad
with the Lean, Python, Rust, and CUDA Rust programming languages!
Made with 🖤🪻 by Jeffrey Zhang, University of Waterloo (BMath)
Made possible by Lambda Labs Research Grant
You are viewing this on a mobile device, but SITP is best viewed on a desktop — the book includes various multimedia lecture videos, visualizers, any tufte-style sidenotes with many external hyperlinks to other resources.
Citation:
@book{zhang2026sitp,
author = "Jeffrey David Zhang",
title = "Structure and Interpretation of Tensor Programs",
year = 2026,
url = "https://sitp.ai"
}