​​💣New open-source recommender system from Facebook.

Facebook is open-sourcing DLRM — a state-of-the-art deep learning recommendation model to help AI researchers and the systems and hardware community develop new, more efficient ways to work with categorical data.

Link: https://ai.facebook.com/blog/dlrm-an-advanced-open-source-deep-learning-recommendation-model/
Github: https://github.com/facebookresearch/dlrm
ArXiV: https://arxiv.org/abs/1906.03109

#Facebook #DLRM #recommender #DL #PyTorch #Caffe

0.2 release of PyTorchPipe

Library for multi-modal deep learning pipelines, in a modular fashion for GPU and CPU.

Link: https://github.com/IBM/pytorchpipe

#IBM #PyTorch

​​Release of 27 pretrained models for NLP / NLU for PyTorch

Hugging Face open sources a new library that contains up to 27 pretrained models to conduct state-of-the-art NLP/NLU tasks.

Link: https://medium.com/dair-ai/pytorch-transformers-for-state-of-the-art-nlp-3348911ffa5b

#SOTA #NLP #NLU #PyTorch #opensource

PyTorch for research

PyTorch Lightning — The PyTorch Keras for ML researchers. More control. Less boilerplate.

Github: https://github.com/williamFalcon/pytorch-lightning

#PyTorch #Research #OpenSource

spaCy meets PyTorch-Transformers: Fine-tune BERT, XLNet and GPT-2

Including pretrained models.

Link: https://explosion.ai/blog/spacy-pytorch-transformers
Pip: pip install spacy-pytorch-transformers

#Transformers #SpaCy #NLP #NLU #PyTorch #Bert #XLNet #GPT

Great collections of Data Science learning materials

The list includes free books and online courses on range of DS-related disciplines:

Machine learning (#ML)
Deep Learning (#DL)
Reinforcement learning (#RL)
#NLP

Tutorials on #Keras, #Tensorflow, #Torch, #PyTorch, #Theano

Notable researchers, papers and even #datasets. It is a great place to start reviewing your knowledge or learning something new.

Link: https://hackmd.io/@chanderA/aiguide

#wheretostart #entrylevel #novice #studycontent #studymaterials #books #MOOC #meta

​​GANs from Scratch 1: A deep introduction.

Great introduction and tutorial. With code in PyTorch and TensorFlow

Link: https://medium.com/ai-society/gans-from-scratch-1-a-deep-introduction-with-code-in-pytorch-and-tensorflow-cb03cdcdba0f

#tensorflow #pytorch #GAN #tutorial #entrylevel #novice #wheretostart

Video on how Facebook continues to develop its #Portal device

How #Facebook used Mask R-CNN, #PyTorch, and custom hardware integrations like foveated processing to improve Portal’s Smart Camera system.

Link: https://ai.facebook.com/blog/smart-camera-portal-advances/

#CV #DL #Segmentation

PyTorch 1.3 released

- named tensors support
- general availability of Google Cloud TPU support
- captum - SOTA tools to understand how the importance of specific neurons and layers affect predictions made by the models
- crypten - a new research tool for secure machine learning with PyTorch
- many other improvements

Official announce: https://pytorch.org/blog/pytorch-1-dot-3-adds-mobile-privacy-quantization-and-named-tensors/
Captum website: https://www.captum.ai
CrypTen code: https://github.com/facebookresearch/CrypTen
#DL #PyTorch #TPU #GCP #Captum #CrypTen

🎓 Reinforcement Learning Course from OpenAI

Reinforcement Learning becoming significant part of the data scientist toolbox.
OpenAI created and published one of the best courses in #RL. Algorithms implementation written in #Tensorflow.
But if you are more comfortable with #PyTorch, we have found #PyTorch implementation of this algs

OpenAI Course: https://spinningup.openai.com/en/latest/
Tensorflow Code: https://github.com/openai/spinningup
PyTorch Code: https://github.com/kashif/firedup

#MOOC #edu #course #OpenAI