LowRankArena standardizes SVD-based LLM compression evaluation and reveals that method rankings and speedups depend heavily on backbone and workload under aligned protocols.
Swimba routes expert SSM streams via parameter-space MoE to scale selective state space model capacity without increasing recurrent state update costs. Under matched FLOPs, it achieves slightly better average performance with minor latency and throughput trade-offs.