"The Bitter Lesson"
The biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin.
In computer chess, the methods that defeated the world champion, Kasparov, in 1997, were based on massive, deep search (…) A similar pattern of research progress was seen in computer Go, only delayed by a further 20 years.
One thing that should be learned from the bitter lesson is the great power of general purpose methods, of methods that continue to scale with increased computation, even as the available computation becomes very great. The two methods that seem to scale arbitrarily in this way are search and learning.
Rich Sutton, March 13, 2019: http://www.incompleteideas.net/IncIdeas/BitterLesson.html
#Learning #ReinforcementLearning #Search
The biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin.
In computer chess, the methods that defeated the world champion, Kasparov, in 1997, were based on massive, deep search (…) A similar pattern of research progress was seen in computer Go, only delayed by a further 20 years.
One thing that should be learned from the bitter lesson is the great power of general purpose methods, of methods that continue to scale with increased computation, even as the available computation becomes very great. The two methods that seem to scale arbitrarily in this way are search and learning.
Rich Sutton, March 13, 2019: http://www.incompleteideas.net/IncIdeas/BitterLesson.html
#Learning #ReinforcementLearning #Search