Vanishing/exploring gradients problem is a well often problem especially when training big networks, so visualizing gradients is a must when training neural networks. Here is the small network's on MNIST dataset gradients flow. A detailed article is on the way to explain many things in deep learning.

#machinelearning #deeplearning #artificialintelligence #computervision #neuralnetwork

❇️ @AI_Python_EN

New State of the Art AI Optimizer: Rectified Adam (RAdam) Improve your AI accuracy instantly versus Adam, and why it works. Blog by Less Wright :

https://medium.com/@lessw/new-state-of-the-art-ai-optimizer-rectified-adam-radam-5d854730807b

#MachineLearning #TensorFlow #Pytorch #DeepLearning

❇️ @AI_Python_EN

Free 81-page guide on learning #ComputerVision, #DeepLearning, and #OpenCV!

Includes step-by-step instructions on:
- Getting Started
- Face Applications
- Object Detection
- OCR
- Embedded/IoT
- ...and more

https://www.pyimagesearch.com/start-here

Yoshua explains how #DeepLearning has developed in 2019
https://www.youtube.com/watch?v=eKMA1Tscdag

❇️ @AI_Python_EN