Gustav 2026-10-08 · Machine learning
Do Good Small Blocks Make Good Deep Networks?
We test whether a good small block stays good when stacked, whether pretraining it beats random initialisation at equal compute, how to spend a search budget, and whether to scale by depth or width.