Good Papers

Showing papers from Harvard / MSR Show all papers

86%Must read
?Must readVote to see the score

Bridging Compute- and Data-Optimal Pretraining

A unified compute-data scaling framework introduces token effectiveness to bridge data-rich and fixed-corpus regimes, showing diminishing returns and three operational regimes that render classical compute-optimal allocations suboptimal.

Tian Qin, Kimia Hamidieh, David Alvarez-Melis

Sydney Poster Session 4, Wed, Dec 9, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026 · ▲ 1 on Hugging Face

– ReadersNo votes yet
14/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 14 of 20 reviewers recommend it
lenient 5/5
medium 8/10
strict 1/5