Calculus on Computational Graphs: Backpropagation
colah's blog
JANUARY 26, 2023
Backpropagation is the key algorithm that makes training deep models computationally tractable. In fact, the algorithm has been reinvented at least dozens of times in different fields (see Griewank (2010) ). That’s the difference between a model taking a week to train and taking 200,000 years.
Let's personalize your content