Good Papers

Showing papers from Flatiron Institute, Simons Foundation Show all papers

76%Highly rated
?Highly ratedVote to see the score
NeurIPS 2026UC BerkeleyPrincetonU Toronto & Vector InstituteFlatiron Institute, Simons FoundOptimization

Sharp Capacity Scaling of Spectral Optimizers in Learning Associative Memory

Spectral optimizer Muon exceeds SGD associative memory capacity, matching Newton's method with first-order updates and larger critical batch sizes.

Juno Kim, Eshaan Nichani, Denny Wu, Alberto Bietti and 1 more

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

– ReadersNo votes yet
10/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 10 of 20 reviewers recommend it
lenient 3/5
medium 4/10
strict 3/5
88%Must read
?Must readVote to see the score
NeurIPS 2026New YorkWeizmann Institute of TechnologyNYUFlatiron Institute, Simons FoundMechanistic interpretability

Geometric Factual Recall in Transformers

Transformers memorize facts geometrically via linear superpositions and MLP selectors, needing only logarithmic dimensions and enabling zero-shot MLP transfer.

Shauli Ravfogel, Gilad Yehudai, Joan Bruna, Alberto Bietti

Paris Poster Session 3, Thu, Dec 10, 12:30 PM–2:30 PM, Paris Poster Hall · Published 2026 · ▲ 1 on Hugging Face

– ReadersNo votes yet
15/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 15 of 20 reviewers recommend it
lenient 4/5
medium 7/10
strict 4/5