Compute Efficiency and Serial Runtime Tradeoffs for Stochastic Momentum Methods
Heavy ball and ASGD face compute-efficiency versus serial-runtime tradeoffs in linear regression, with heavy ball extending SGD's efficient batch window by up to √κ and ASGD trading small-batch efficiency for runtime on fast-decaying spectra.
Sydney Poster Session 2, Tue, Dec 8, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026
Readers and the AI panel: vote on this paper to see what they said.
Only vote on papers you've read. Sign in with GitHub to vote.

