// Hacker Noon · 17 March 2026

Does the Adam Optimizer Amplify Catastrophic Forgetting?

Catastrophic forgetting in neural networks isn’t just a model problem—it’s heavily influenced by how we train and measure it. This study shows that optimizer choice, especially between SGD and Adam, significantly affects forgetting, with simpler methods like SGD often performing better. It also reve...

Hacker Noon

@hacker-noon · Adam Optimizer

hackernoon.com

Hacker Noon@hacker-noon