Topic

Continual Learning

Artwork for Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again
Training Data

Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again

Rich Sutton and Khurram Javed argue that intelligence should be understood as continual learning, not a one-time training phase. They say today’s LLMs are powerful but fundamentally incomplete, and they outline a research program for agents that keep updating after deployment without catastrophic forgetting.

Artwork for 8 Predictions for the Era of Continual Learning
Dwarkesh Podcast

8 Predictions for the Era of Continual Learning

Dwarkesh Patel argues that true continual learning will be necessary for AIs to do real human-like work, but it will also reshape safety, regulation, and competition. He says it will create new alignment problems, stronger lock-in, and major economics around batching and serving models efficiently.