Browsing: Grokking

In 2022, a small team of researchers ran an experiment that should have been unremarkable. They trained a tiny neural network, far smaller than anything that gets called “AI” today, on one of the simplest tasks imaginable: modular addition, basically clock math. What is 8 plus 7 if the clock only goes up to 12?…