This is a blog about my research ideas. I try to keep things simple and visual.

Recent posts

How ResNets fix the Loss Surface

In the last post of this series, we came to understand that harmonic distortions created by repeatedly applying ReLU layers are responsible for the rough los...