# David Balduzzi Named the "shattered gradients" problem (2017). Topic: [[Topics/LLMs/LLMs|LLMs]] · [[Topics/LLMs/Sources|Sources]] - Lead author of "The Shattered Gradients Problem: If resnets are the answer, then what is the question?" with Marcus Frean, Lennox Leary, JP Lewis, Kurt Wan-Duo Ma and Brian McWilliams (ICML 2017) ([arXiv](https://arxiv.org/abs/1702.08591)). - Showed that "the correlation between gradients in standard feedforward networks decays exponentially with depth", so the gradients look like white noise, while in ResNets the decay is far slower. This is a **2017** explanation of why ResNets work; it is not how the 2015 paper described the problem.