Learned stochastic stopping reduces out-of-distribution variance in looped transformers by decoupling loop count from sequence length during training. It improves accuracy-stability trade-offs across algorithmic tasks, though it can stabilize suboptimal computation.
Self-supervised pre-training on one real table yields strong tabular transfer, where feature count predicts usefulness and in-context generalization is retrieval-based.
A framework samples coherent but cognitively unavailable "alien" research directions by maximizing idea coherence while minimizing existing community availability, broadening explored vocabularies 3.5-7x over LLM baselines.
CCBR builds recommendations from textual user profiles via content-derived text bottlenecks, enabling controllable multimodal steering with competitive accuracy across image, audio, and video datasets.
Reasoning is formalized via optimal transport to bound transformers' OOD generalization by architectural Lipschitz continuity and approximation limits, proving depth is needed for backtracking and shift-invariant attention reduces risk.
GeneZip uses region-aware compression to achieve high base-pairs-per-token ratios, improves DNA modeling benchmarks, and enables 128K-context training on limited hardware.