[2602.03655] Sequential Group Composition: A Window into the Mechanics of Deep Learning
https://arxiv.org/abs/2602.03655
https://arxiv.org/abs/2602.03655
arXiv.org
Sequential Group Composition: A Window into the Mechanics of Deep Learning
How do neural networks trained over sequences acquire the ability to perform structured operations, such as arithmetic, geometric, and algorithmic computation? To gain insight into this question,...
Automatic differentiation - Wikipedia
https://en.wikipedia.org/wiki/Automatic_differentiation
https://en.wikipedia.org/wiki/Automatic_differentiation
Wikipedia
Automatic differentiation
In mathematics and computer algebra, automatic differentiation (auto-differentiation, autodiff, or AD), also called algorithmic differentiation, computational differentiation, and differentiation arithmetic is a set of techniques to evaluate the partial derivativeβ¦