The Data Black Hole at the Center of AI

Dwarkesh Patel's crisp 12-minute video argues that AI's real bottleneck is sample efficiency, not compute — humans learn from ~200M words while frontier models train on trillions of tokens. Notes on scaling laws, distillation, and whether AI can solve its own data hunger.

Federico Ulfo