doing something
https://github.com/NVIDIA/TransformerEngine/issues/1014 #daily_pain
Installed cudnn and it seems that building works
Forwarded from Hacker News
ruder.io
An overview of gradient descent optimization algorithms
Gradient descent is the preferred way to optimize neural networks and many other machine learning algorithms but is often used as a black box. This post explores how many of the most popular gradient-based optimization algorithms such as Momentum, Adagrad…