New "Simple Self Attention" Layer
GitHub by Sébastien Doria: https://github.com/sdoria/SimpleSelfAttention
#MachineLearning #Pytorch #FastAI #SelfAttention

An Algorithmic Barrier to Neural Circuit Understanding
Venkatakrishnan Ramaswamy: https://www.biorxiv.org/content/10.1101/639724v1
#Algorithme #Neuroscience #innovation #technology

ArviZ: Exploratory analysis of Bayesian models
Includes functions for posterior analysis, sample diagnostics, model checking, and comparison: https://arviz-devs.github.io/arviz/
#ArtificialIntelligence #Bayesian #BayesianInference #MachineLearning #Python

VAE-SBD
PyTorch implementation of the Variational Autoencoder with Spatial Broadcast Decoder.
GitHub by Daniel Daza: https://github.com/dfdazac/vaesbd
#deeplearning #pytorch #technology #innovation

A curated list of gradient boosting research papers with implementations.

https://github.com/benedekrozemberczki/awesome-gradient-boosting-papers

How to Perform Object Detection With YOLOv3 in Keras
https://machinelearningmastery.com/how-to-perform-object-detection-with-yolov3-in-keras/

STAT479: Deep Learning (Spring 2019)
Instructor: Sebastian Raschka

Course material for STAT 479: Deep Learning (SS 2019) at University Wisconsin-Madison

https://github.com/rasbt/stat479-deep-learning-ss19

PyTorch prerequisites - Neural network programming series
http://deeplizard.com/learn/video/v5cngxo4mIg

Optimizing Steering Car Paths with PyTorch
http://blog.benwiener.com/programming/2019/05/14/steering-car.html

The mathematics of machine learning and deep learning

https://www.youtube.com/watch?v=r07Sofj_puQ

Handtrack.js: Hand Tracking Interactions in the Browser using Tensorflow.js and 3 lines of code
Blog by Victor Dibia: https://towardsdatascience.com/handtrackjs-677c29c1d585
#JavaScript #MachineLearning #ArtificialIntelligence #TensorFlow #TensorFlowJS

State of the art video editing - make any object in a video invisible!

Deep Flow-Guided Video Inpainting
paper: https://www.profillic.com/paper/arxiv:1905.02884

Speech2Face: Learning the Face Behind a Voice.

By MIT CSAIL: https://arxiv.org/pdf/1905.09773.pdf

"The term “artificial intelligence” dates back to the mid-1950s, when mathematician John McCarthy, widely recognized as the father of AI, used it to describe machines that do things people might call intelligent. He and Marvin Minsky, whose work was just as influential in the AI field, organized the Dartmouth Summer Research Project on Artificial Intelligence in 1956. A few years later, with McCarthy on the faculty, MIT founded its Artificial Intelligence Project, later the AI Lab. It merged with the Laboratory for Computer Science (LCS) in 2003 and was renamed the Computer Science and Artificial Intelligence Laboratory, or CSAIL."


https://www.the-scientist.com/magazine-issue/artificial-intelligence-versus-neural-networks-65802

Limitations of Deep Learning for Vision, and How We Might Fix Them by Alan L. Yuille, Chenxi Liu: https://thegradient.pub/the-limitations-of-visual-deep-lea…/

The most serious challenge is how to develop algorithms that can deal with the combinatorial explosion as researchers address increasingly complex visual tasks in increasingly realistic conditions.

An Explicitly Relational Neural Network Architecture
Shanahan et al.: https://arxiv.org/abs/1905.10307
#deeplearning #neuralnetworks #symbolicAI

Learning to learn by Self-Critique
Antreas Antoniou and Amos Storkey: https://arxiv.org/abs/1905.10295
#ArtificialIntelligence #DeepLearning #MachineLearning

"A Latent Variational Framework for Stochastic Optimization"
By Philippe Casgrain: https://arxiv.org/abs/1905.01707
#ArtificialIntelligence #MachineLearning #Probability #Computation

Last week, Yann LeCun, Stanley Osher, René Vidal, Rebecca Willett and I organized the workshop "Deep Geometric Learning of Big Data and Applications" at Institute for Pure and Applied Mathematics, UCLA.

All talks, from theoretical to practical deep learning, were pretty inspiring. All videos are available here:
https://www.ipam.ucla.edu/programs/workshops/workshop-iv-deep-geometric-learning-of-big-data-and-applications/?tab=schedule

Thanks to all speakers, poster presenters, participants and IPAM for a wonderful and insightful week!

Aude Oliva (MIT): "there are about 200 papers using ConvNets to model the activity of the primate visual cortex."

She is running a challenge to explain fMRI and MEG data: http://algonauts.csail.mit.edu/challenge.html @ArtificialIntelligenceArticles