// Hacker Noon · 19 March 2026

Why Adam May Be Hurting Your Neural Network’s Memory

This study shows that optimizer choice has a major impact on catastrophic forgetting in neural networks, with SGD consistently outperforming Adam and RMSProp. While hyperparameters influence outcomes, the optimizer itself plays a larger role. The findings also reveal that commonly used metrics like...

Hacker Noon

@hacker-noon · Adam Optimizer

hackernoon.com

Hacker Noon@hacker-noon