Research

I am currently writing down some of my published research ideas in lighter, more intuitive blog style. The following series of blog posts are available:

Blog

Loss Landscapes (Part 1)
Loss Landscapes (Part 2)
Nonlinear Advantage

Talks

Ringing ReLUs (ICLR 2021 Poster Video)
Nonlinear Advantage (ICML 2023 Poster Video)
On the Weight Dynamics of Deep Normalized Networks (ICML 2024 Poster Video)

Papers

Ringing ReLUs (ICLR 2021 Paper)
Nonlinear Advantage (ICML 2023 Paper)
On the Weight Dynamics of Deep Normalized Networks (ICML 2024 Paper)
ResNets Are Deeper Than You Think (NeurIPS 2025 Submission)