Why did Sutton emphasize the 'Bitter Lesson' in AI?
The 'Bitter Lesson' is an observation that, over the history of AI, methods that perform extensive computation, such as search and learning, have consistently outperformed approaches that rely on human-engineered knowledge or heuristics. It’s a lesson that has been learned repeatedly, often painfully, because we humans tend to favor our own insights. My point is that we should be more open to embracing these powerful, computation-heavy methods.
Ask Richard S. Sutton the follow-up →