Uniform Scaling Limits in AdamW-Trained Transformers
2026-05-13T07:23:57Z•a775b843fcf21f97a1c9372b9896377eee142f4e405924453db1e315f5d10a2f
ADMMAdamWBayesian-KANsGaussian-processGibbs-samplingLie-algebraMcKean-VlasovSO(3)Stiefel-optimizationThompson-samplingU-statisticsactive-inferenceadaptive-experimentationattention-mechanismlow-rank-covariancenetwork-interferencepost-ADC-inferenceprobabilistic-PLSrotational-anisotropyscaling-limitsselective-inferencespatial-adapterspectral-distillationtransformerstree-ensembles
What happened
Collection of 11 new stat‑ML preprints (arXiv 13 May 2026) covering theoretical and methodological advances: provable uniform scaling limits for transformers trained with AdamW (forward–backward ODE/MVODE limits and uniform-initial-condition convergence rates); an interpretable SO(3)-parameterised rotationally anisotropic Gaussian process kernel; Thompson-sampling + Gibbs algorithm for adaptive experimentation under unknown network interference with regret bounds and graph-discovery analysis; the Spatial Adapter — a parameter-efficient post-hoc layer that furnishes closed-form low-rank-plus-no
Why it matters
A reviewed impact interpretation has not been published for this record.
Evidence and limitations
- Source ID
- arxiv_stat_ml
- Record identifier
- a775b843fcf21f97a1c9372b9896377eee142f4e405924453db1e315f5d10a2f
- Enrichment time
- 2026-05-13T07:23:57Z
- AI-assisted enrichment
- Yes
This record may overlap with other records. Its enrichment can be incomplete or wrong, and machine assistance was used. Validate consequential decisions against the linked source and your own environment.