Pitfalls of Batch Norm in TensorFlow and Sanity Checks for Training Networks

Some more practical advices on #tensorflow training with source code and reference links to look up.

https://medium.com/@theshank/pitfalls-of-batch-norm-in-tensorflow-and-sanity-checks-for-training-networks-e86c207548c8

#beginner #novice #dl #tutorial

Introduction to Python Ensembles

Ensemble is an approach for mixing algorithms to obtain strong sides of all the approaches.

https://www.kdnuggets.com/2018/02/introduction-python-ensembles.html

#ensemble #stacking #tutorial #beginnig #novice

Most common pitfalls, you can encounter when training neural network.

http://telegra.ph/Most-common-neural-network-mistakes-07-01

#beginner #novice #dl #tutorial

Deep Learning for Matching in Search and Recommendation

PDF: http://www.comp.nus.edu.sg/~xiangnan/sigir18-deep.pdf

#sigir2018 #Tutorial

Toward theoretical understanding of deep learning

http://unsupervised.cs.princeton.edu/deeplearningtutorial.html

#ICML2018 #tutorial #dl

Complete code examples for Machine Translation with Attention, Image Captioning, Text Generation, and DCGAN implemented with tf.keras and eager execution

“Complete code examples for Machine Translation with Attention, Image Captioning, Text Generation…” https://medium.com/tensorflow/complete-code-examples-for-machine-translation-with-attention-image-captioning-text-generation-51663d07a63d

#tensorflow #tutorial

Deploying a Machine Learning Model as a REST API

Yet another #tutorial on how to serve #production model with flask.

Link: https://towardsdatascience.com/deploying-a-machine-learning-model-as-a-rest-api-4a03b865c166
Github repo: https://github.com/mnguyenngo/flask-rest-setup/tree/master/sentiment-clf

A set of best where-to-start-with-python resources.

This is the collection of beginners resources from a tweet by fast.ai cofounder, covering any resource which helped people to learn python from scratch.

https://telegra.ph/A-collection-of-where-to-start-python-resources-11-05

#beginner #novice #CS #python #tutorial

Implementing a ResNet model from scratch.

Well-written and explained note on how to build and train a ResNet model from ground zero.

Link: https://towardsdatascience.com/implementing-a-resnet-model-from-scratch-971be7193718

#ResNet #DL #CV #nn #tutorial

Deep learning for NLP crash course at ABBYY.

Github repo with scheduled plan for learning #DL #NLP online.

Link: https://github.com/DanAnastasyev/DeepNLP-Course

#educational #tutorial #course #beginner #novice #entrylevel

Using Nucleus and TensorFlow for DNA Sequencing Error Correction

This is a new #tutorial of the Genomics team in #GoogleBrain. Good place to start with #deeplearning for #genomics using Nucleus and #Tensorflow.

Link: https://medium.com/tensorflow/using-nucleus-and-tensorflow-for-dna-sequencing-error-correction-47f3f7fc1a50
Google colab: https://colab.research.google.com/github/google/nucleus/blob/master/nucleus/examples/dna_sequencing_error_correction.ipynb

#Google #healthcare

Really short and brief, yet useful #tutorial on #PyTorch #transferlearning

Transfer learning is a concept of using network trained for a certain task for another one.

Link: https://medium.com/@iamHarin17/transfer-learning-in-pytorch-f7736598b1ed

#DL #novice #entrylevel #beginner

#Google has open-sourced #FederatedLearning code

Step-by-step #tutorial showing how to perform Federated Learning using the same infrastructure Google
uses on 10s of millions of smartphones.

Link: https://medium.com/tensorflow/introducing-tensorflow-federated-a4147aa20041

A Recipe for Training Neural Networks by Andrej Karpathy

New article written by Andrej Karpathy distilling a bunch of useful heuristics for training neural nets. The post is full of real-world knowledge and how-to details that are not taught in books and often take endless hours to learn the hard way.

Link: https://karpathy.github.io/2019/04/25/recipe/

#tipsandtricks #karpathy #tutorial #nn #ml #dl

​​🐣 Conversational AI building tutorial, open-source code & demo!

Building a SOTA Conversational AI with transfer learning & OpenAI GPT models

Code/pretrained model from NeurIPS 2018 ConvAI2 competition model, SOTA on automatic track
Detailed Tutorial w. code

Tutorial: https://medium.com/huggingface/how-to-build-a-state-of-the-art-conversational-ai-with-transfer-learning-2d818ac26313
Demo: http://convai.huggingface.co
Code: https://github.com/huggingface/transfer-learning-conv-ai

#tutorial #novice

​​GANs from Scratch 1: A deep introduction.

Great introduction and tutorial. With code in PyTorch and TensorFlow

Link: https://medium.com/ai-society/gans-from-scratch-1-a-deep-introduction-with-code-in-pytorch-and-tensorflow-cb03cdcdba0f

#tensorflow #pytorch #GAN #tutorial #entrylevel #novice #wheretostart

Big scandal on popular YouTuber ML course

Siraj Raval, who raised his audience on devliering various YouTube videos, explaning #ML and #DL concepts as long with interviews with leading persons, launched his own course, but failed to provide much value.

His course was built on open and free tutorials, created by passionate enthusiasts, but he failed to attribute them properly and charged money for ununique content without any proper support for students.

He also oversold his course and tried to hide that from students, claiming to provide personal feedbacks, but failing to do so due to being too greedy.


Most of the best online courses and study programms are available online and for free, including those, we gathered here on our channel and attributed with hastags #wheretostart #entrylevel #MOOC #tutorial. Feel free to click these hashtags and browse for best available resources to start learning data science.

Link: https://www.theregister.co.uk/AMP/2019/09/27/youtube_ai_star

​​New tutorial on QA task

The T5 team competed against T5 in a "pub quiz" on (context-free) questions from the TriviaQA/NQ validation sets.
Result: team got 20% right; T5 got 35%.
Colab link: https://colab.research.google.com/github/google-research/text-to-text-transfer-transformer/blob/master/notebooks/t5-trivia.ipynb
Source: twitter

#NLU #NLP #Colab #Tutorial #QA

P-value, explained, one more time with demos

Article includes not only great explanation of what is #pvalue, but how it works and how it can be used to make a correct conclusions.

Link:https://www.freecodecamp.org/news/what-is-statistical-significance-p-value-defined-and-how-to-calculate-it/

#entrylevel #dsformanagers #tutorial #explained #interactive #statistics

​​Tutorial on Generative Adversarial Networks (GANs) with Keras and TensorFlow

Nice tutorial with enough theory to understand what you are doing and code to get it done.

Link: https://www.pyimagesearch.com/2020/11/16/gans-with-keras-and-tensorflow/

#Keras #TensorFlow #tutorial #wheretostart #GAN