Statistician: How might you analyze this data

Data scientist: Definitely start with a neural net

Statistician:

Alright, fine, start off with a multiple regression with every possible covariate, look at the t-tests and remove those that aren't significant.
Statistician: have you tried PCA?

Data scientist: no, but I'm using a linearly-activated autoencoder, and that seems to work pretty well.

Statistician: ...

❇ @AI_Python
✴ @AI_Python_EN

Transformers working for RL! Two simple modifications: move layer-norm and add gating creates GTrXL: an incredibly stable and effective architecture for integrating experience through time in RL.
https://arxiv.org/abs/1910.06764

❇️ @AI_Python
✴️ @AI_Python_EN

Uncertainty Quantification in Deep Learning

https://www.inovex.de/blog/uncertainty-quantification-deep-learning/

Most of the world’s text is not in English. We are releasing MultiFiT to train and fine-tune language models efficiently in any language.
Post:
http://nlp.fast.ai/classification/2019/09/10/multifit.html
Paper:
https://arxiv.org/abs/1909.04761

✴ @AI_Python_EN

Did you run any experiments in XNLI? Also curious how it compares to XLM. Also, shameless plug for the cross-lingual QA dataset we just released, MLQA
https://github.com/facebookresearch/MLQA - could be a great testbed for models like this

❇ @AI_Python_EN

XNLI and MLQA needs bidirectional context, and multifit is unidirectional since it uses casual language modeling and RNNs. But it is on the todo list just below of training multifit in zeroshoot scenario with XLM as a teacher model.

❇ @AI_Python_EN

Does the brain do backpropagation? CAN Public Lecture - Geoffrey Hinton

https://www.youtube.com/watch?v=qIEfJ6OBGj8

❇ @AI_Python_EN

Netflix Open-sourcing Polynote: an IDE-inspired polyglot notebook

#DataScience #MachineLearning #ArtificialIntelligence

http://bit.ly/2N9m8qe


❇️ @AI_Python_EN

Omid Sarfarzadeh and Maysam Asgari-Chenaghlu , we will have a session on #DeepNLP and it’s applications to #SearchEngine and #Chatbot in #Google’s #DevFest, Istanbul. We will be honored to represent adesso Turkey. Thanks to Tufan K. and all adesso Turkey family to provide this chance for us. More information is provided as follows:
#DeepLearning #DeepNLP #NLP #chatbot #SearchEngine #adesso #adessoTurkey

https://devfest.istanbul
https://dfist19.firebaseapp.com/

❇ @AI_Python_EN

Google is now using BERT to improve its core search algorithm. It has been live now for the past couple of days for search queries made in English in the US. A/B tests have shown good results so far. That's huge news especially for people who make money on web traffic! #deeplearning #machinelearning
📝 Article:
https://lnkd.in/d_fwVeg

Google is training graph neural networks to predict smells

#DataScience #MachineLearning #ArtificialIntelligence

http://bit.ly/344EaAZ

❇️ @AI_Python_EN

Public datasets: weather and climate Google Cloud’s Public Datasets Program :
https://lnkd.in/edhe7wj

#ArtificialIntelligence #Datasets

✴ @AI_Python_EN

When regression models perform poorly, there are typically several reasons. Here are some:

Important variables have been omitted from the model. These may include latent (unobservable) variables, such as socio-economic status.

Errors in the data and missing data.

Measurement error. This is not the same as data errors.

The wrong type of regression was used - there are many kinds of regression models. For example, OLS linear regression was used for count data.

Moderated effects (interactions) were ignored or improperly modeled. A simple example would be when the relationship between age and purchase frequency depends on gender but this has not been accounted for.

Curvilinear effects have been ignored or modeled improperly. For example, the relationship between age and expenditures often does not follow a straight-line path.

Heterogeneity has been ignored or modeled incorrectly. There may be several segments of consumers with different drivers (preferences), for instance.

Our expectations were wrong - the data are low-signal and there's little value to be extracted whatever we do.

Often these errors can be avoided or fixed with little effort, but the person doing the modeling must know how. Unfortunately, some people using regression have little understanding of it.

✴️ @AI_Python_EN

Regression is a very general term - notice the similarities between neural nets and regression, for instance. Another example is structural equation modeling (SEM). About 40 years ago UCLA professor Peter Bentler and his doctoral student David Weeks showed how SEM could be represented as regression, which reduced the number of required matrices from eight in the traditional LISREL notation to three. Results will be identical. Factor analysis and latent class clustering can also be conceptualized as regression.
I did not have space to mention clustered (multilevel) data. In some cases ignoring hierarchical structure in data can be very consequential and cause us to misinterpret our data. Sometimes different models are required for different levels of the data, as well.

✴️ @AI_Python_EN

FUNIT: Few-Shot Unsupervised Image-to-Image Translation

Code on GitHub:
http://bit.ly/2patFxh

Link to Paper:
https://lnkd.in/ekgDy5u

Link to Blog Post:
https://bit.ly/2JIm28n

#DataScience #MachineLearning #ArtificialIntelligence

✴️ @AI_Python_EN

Pytorch-Struct

Fast, general, and tested differentiable structured prediction in PyTorch. By Harvard NLP : https://lnkd.in/e2iGiNa

#PyTorch #DeepLearning #ArtificialIntelligence

✴️ @AI_Python_EN

Evaluating the Factual Consistency of Abstractive Text Summarization
https://lnkd.in/ewFMX8T

#ArtificialIntelligence #DeepLearning #NLP #NaturalLanguageProcessing

✴ @AI_Python_EN

PaperRobot: Incremental Draft Generation of Scientific Ideas
https://lnkd.in/exHGHjW

#ArtificialIntelligence #AI #MachineLearning #DeepLearning

❇ @AI_Python_EN

Look then Listen: Pre-Learning Environment Representations for Data-Efficient Neural Instruction Following

http://bit.ly/2Pn3PR4

#DataScience #MachineLearning #ArtificialIntelligence

✴ @AI_Python_EN

Deep learning hits mathematical theorem proofs

#deeplearning #artificialintelligence

https://arxiv.org/abs/1910.11797

❇ @AI_Python_EN

ICCV 2019 Best Papers Announced

https://medium.com/syncedreview/iccv-2019-best-papers-announced-27a1a21311e1


✴️ @AI_Python_EN