Transolver-GMsFEM: A Hybrid Framework for High-Contrast Multiscale PDEs on Irregular Grids

Alexander Rudikov, Sergei Stepanov, Vladimir Fanaskov, Eric Chung and 2 more

Atlanta Poster Session 4, Thu, Dec 10, 4:30 PM–7:30 PM, Hall C1 · Published 2026

Sanity Checks for Sparse Autoencoders: Do SAEs Beat Random Baselines?

Anton Korznikov, Andrey V Galichin, Alexey Dontsov, Oleg Rogov and 2 more

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

Structured Transforms for Low-Overhead Quantization of Language Models

Replacing dense orthogonal matrices with sign-randomized DCTs accelerates Kashin-based LLM quantization to O(N log N) with guaranteed convergence, achieving 4-bit accuracy competitive with OPTQ and QuIP while maintaining numerical stability and native 2-bit hardware compatibility.

Daria Cherniuk, Alexander Rudikov, Boris Kashin, Ivan Oseledets

Sydney Poster Session 6, Thu, Dec 10, 5:00 PM–8:00 PM, Hall 1-4 · Published 2026

TUBE: Tangent Upper Bound on Evidence for Discrete Diffusion Language Models

TUBE introduces a variational upper bound with unbiased Monte Carlo estimation to evaluate discrete diffusion model log-likelihoods, revealing that block diffusion and any-order autoregressive models remain below exact autoregressive baselines.

Arseny Ivanov, Sergei Kholkin, Vladislav Gromadskii, Grigoriy Ksenofontov and 2 more

Paris Poster Session 2, Wed, Dec 9, 5:00 PM–7:00 PM, Paris Poster Hall · Published 2026