Tutorial 1: Depth vs Width¶

• Exponential expressivity in deep neural networks through transient chaos

Tutorial 2: Double descent¶

• Double Descent: A Visual Introduction

• Double Descent: A Mathematical Explanation

• Deep Double Descent: Where Bigger Models and More Data Hurt

• A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning

Tutorial 3: Modularity¶

• Inductive biases of neural network modularity in spatial navigation