Our conceptual understanding of how best to represent words and sentences in a way that best captures underlying meanings and relationships is rapidly evolving. Among the latest milestones are BERT and ELMo.
This article talks about the concepts one needs to be aware of to properly get his/her head around BERT.
http://jalammar.github.io/illustrated-bert/
#BERT #EMLO #NLP
This article talks about the concepts one needs to be aware of to properly get his/her head around BERT.
http://jalammar.github.io/illustrated-bert/
#BERT #EMLO #NLP
jalammar.github.io
The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning)
Discussions:
Hacker News (98 points, 19 comments), Reddit r/MachineLearning (164 points, 20 comments)
Translations: Chinese (Simplified), French 1, French 2, Japanese, Korean, Persian, Russian, Spanish
2021 Update: I created this brief and highly accessible…
Hacker News (98 points, 19 comments), Reddit r/MachineLearning (164 points, 20 comments)
Translations: Chinese (Simplified), French 1, French 2, Japanese, Korean, Persian, Russian, Spanish
2021 Update: I created this brief and highly accessible…
Transformers and self-attention explained from scratch, also in pythonic language.
#BERT #GPT_2 #Transformer
#python
http://www.peterbloem.nl/blog/transformers
#BERT #GPT_2 #Transformer
#python
http://www.peterbloem.nl/blog/transformers
If computers are so smart, how come they can’t read?
https://www.wired.com/story/adaptation-if-computers-are-so-smart-how-come-they-cant-read/
https://www.wired.com/story/adaptation-if-computers-are-so-smart-how-come-they-cant-read/
WIRED
If Computers Are So Smart, How Come They Can’t Read?
Deep learning excels at learning statistical correlations, but lacks robust ways of understanding how the meanings of sentences relate to their parts.
Do you also see the AI’s reproducibility crisis? Is it also the concern that you have? Is it partly due to the black box ML systems?
https://www.wired.com/story/artificial-intelligence-confronts-reproducibility-crisis
https://www.wired.com/story/artificial-intelligence-confronts-reproducibility-crisis
WIRED
Artificial Intelligence Confronts a 'Reproducibility' Crisis
Machine-learning systems are black boxes even to the researchers that build them. That makes it hard for others to assess the results.
Interesting simulations on epidemic spread and effect of social distancing. Takes about 25 min
https://youtu.be/gxAaO2rsdIs
#DataScience #socialdistancing #simulation
https://youtu.be/gxAaO2rsdIs
#DataScience #socialdistancing #simulation
YouTube
Simulating an epidemic
Experiments with toy SIR models
Help fund future projects: https://www.patreon.com/3blue1brown
An equally valuable form of support is to simply share some of the videos.
Special thanks to these supporters: http://3b1b.co/sir-thanks
Home page: https://www…
Help fund future projects: https://www.patreon.com/3blue1brown
An equally valuable form of support is to simply share some of the videos.
Special thanks to these supporters: http://3b1b.co/sir-thanks
Home page: https://www…
This media is not supported in your browser
VIEW IN TELEGRAM
Anyone experienced this yet 😐 #covid19 #workfromhome
Hi Folks,
Many of you probably follow sentdex (Harrison Kinsley) on YouTube (channel link below). He has great introductory content for #machinelearning.
Recently he also wrapped up a Kickstarter campaign to write a book on how to implement #deeplearning from scratch in #python. The videos for the book are free (on his channel) and a link to the book's site can be found below.
sentdex youtube -> https://lnkd.in/gXkhEv7
kickstarter -> https://lnkd.in/gcVyRa6
book site -> https://nnfs.io/
Many of you probably follow sentdex (Harrison Kinsley) on YouTube (channel link below). He has great introductory content for #machinelearning.
Recently he also wrapped up a Kickstarter campaign to write a book on how to implement #deeplearning from scratch in #python. The videos for the book are free (on his channel) and a link to the book's site can be found below.
sentdex youtube -> https://lnkd.in/gXkhEv7
kickstarter -> https://lnkd.in/gcVyRa6
book site -> https://nnfs.io/
10 times less energy to train deep neural networks with Early Bird - Towards making AI both more environmentally friendly and more inclusive.
#DNN #AI #ML
https://www.sciencedaily.com/releases/2020/05/200518144908.htm
#DNN #AI #ML
https://www.sciencedaily.com/releases/2020/05/200518144908.htm
ScienceDaily
Early Bird uses 10 times less energy to train deep neural networks
Engineers have found a way to train deep neural networks for a fraction of the energy required today. Their Early Bird method finds key network connectivity patterns early in training, reducing the computations and carbon footprint for training deep learning.
Graduate Student Solves Decades-Old Conway Knot Problem
https://www.quantamagazine.org/graduate-student-solves-decades-old-conway-knot-problem-20200519/
https://www.quantamagazine.org/graduate-student-solves-decades-old-conway-knot-problem-20200519/
Quanta Magazine
Graduate Student Solves Decades-Old Conway Knot Problem
It took Lisa Piccirillo less than a week to answer a long-standing question about a strange knot discovered over half a century ago by the legendary John Conway.
Reducing downtime with predictive maintenance in Shell Pernis.
https://amp-ft-com.cdn.ampproject.org/c/s/amp.ft.com/content/bfbac636-ee8b-11e9-a55a-30afa498db1b
https://amp-ft-com.cdn.ampproject.org/c/s/amp.ft.com/content/bfbac636-ee8b-11e9-a55a-30afa498db1b
Special Report
Future of AI and Digital Healthcare
https://www.ft.com/reports/future-ai-digital-healthcare
#AI #ml
Future of AI and Digital Healthcare
https://www.ft.com/reports/future-ai-digital-healthcare
#AI #ml
Microsoft has built one of the top five publicly disclosed supercomputers in the world, making new infrastructure available in Azure to train extremely large artificial intelligence models. #MSBuild2020 #developer #dev #AI #ml
https://blogs.microsoft.com/ai/openai-azure-supercomputer/?_lrsc=e416cecb-3272-4988-a27c-f3b786153103
https://blogs.microsoft.com/ai/openai-azure-supercomputer/?_lrsc=e416cecb-3272-4988-a27c-f3b786153103
AI failures aren’t due to AI models: they fail in data prep and organization. Successful AI models require collection and organization of data first.
https://www.ibm.com/downloads/cas/W16VXMEN
https://www.ibm.com/downloads/cas/W16VXMEN
A very interesting video about manipulating the RNG (Random Number Generator) in Zelda Windwaker to remove chance in speedruns - by using Bayesian Statistics. By creating prior beliefs about where they are in the RNG state and updating these beliefs based on additional observations, they solve the battleship minigame without leaving anything to chance. This might be one of my favorite Youtube videos and shows how you can combine statistics, domain knowledge and creativity into a solution to a seemingly unsolvable problem.
Highly recommend watching this!
#statistics #gaming #RNG #bayesian
https://m.youtube.com/watch?v=1hs451PfFzQ
Highly recommend watching this!
#statistics #gaming #RNG #bayesian
https://m.youtube.com/watch?v=1hs451PfFzQ
YouTube
How We Solved the Worst Minigame in Zelda's History
Twitch: https://www.twitch.tv/linkus7/
After Years of having to deal with Sploosh Kaboom, the Battleship Minigame in The Legend of Zelda: The Wind Waker, we have finally found a way to beat it consistently. This is the result of many people's efforts to…
After Years of having to deal with Sploosh Kaboom, the Battleship Minigame in The Legend of Zelda: The Wind Waker, we have finally found a way to beat it consistently. This is the result of many people's efforts to…
With great power comes great responsibility. And this statement fits exactly the current applications of #artificialintelligence, like #machinevision #facialregonition.
There are two main concerns here - one is #privacy, the other one is the cost of an error or misclassification.
While most of us are busy in developing algorithms and applications, it's important to keep these concerns in mind.
And then only we can move from #ai to responsible AI #responsibleai.
This latest one from Last week tonight is an eye-opener.
https://m.youtube.com/watch?v=jZjmlJPJgug&feature=share
There are two main concerns here - one is #privacy, the other one is the cost of an error or misclassification.
While most of us are busy in developing algorithms and applications, it's important to keep these concerns in mind.
And then only we can move from #ai to responsible AI #responsibleai.
This latest one from Last week tonight is an eye-opener.
https://m.youtube.com/watch?v=jZjmlJPJgug&feature=share
YouTube
Facial Recognition: Last Week Tonight with John Oliver (HBO)
John Oliver takes a look at facial recognition technology, how it’s used by private companies and law enforcement, and why it can be dangerous.
Connect with Last Week Tonight online...
Subscribe to the Last Week Tonight YouTube channel for more almost…
Connect with Last Week Tonight online...
Subscribe to the Last Week Tonight YouTube channel for more almost…
There is a new kid on the block for serving #artificialintelligence models. FastAPI is quickly replacing #flask as the go to #python framework. It’s simple to use and... fast, great combination. Checkout the docs and repo
docs -> https://lnkd.in/eaqxxdS
repo -> https://lnkd.in/ewSVm-a
docs -> https://lnkd.in/eaqxxdS
repo -> https://lnkd.in/ewSVm-a
lnkd.in
LinkedIn
This link will take you to a page that’s not on LinkedIn