Uniform Scaling Limits in AdamW-Trained Transformers

2026-05-13T07:23:57Za775b843fcf21f97a1c9372b9896377eee142f4e405924453db1e315f5d10a2f
ADMMAdamWBayesian-KANsGaussian-processGibbs-samplingLie-algebraMcKean-VlasovSO(3)Stiefel-optimizationThompson-samplingU-statisticsactive-inferenceadaptive-experimentationattention-mechanismlow-rank-covariancenetwork-interferencepost-ADC-inferenceprobabilistic-PLSrotational-anisotropyscaling-limitsselective-inferencespatial-adapterspectral-distillationtransformerstree-ensembles

What happened

Collection of 11 new stat‑ML preprints (arXiv 13 May 2026) covering theoretical and methodological advances: provable uniform scaling limits for transformers trained with AdamW (forward–backward ODE/MVODE limits and uniform-initial-condition convergence rates); an interpretable SO(3)-parameterised rotationally anisotropic Gaussian process kernel; Thompson-sampling + Gibbs algorithm for adaptive experimentation under unknown network interference with regret bounds and graph-discovery analysis; the Spatial Adapter — a parameter-efficient post-hoc layer that furnishes closed-form low-rank-plus-no

Why it matters

A reviewed impact interpretation has not been published for this record.

Evidence and limitations

Source ID
arxiv_stat_ml
Record identifier
a775b843fcf21f97a1c9372b9896377eee142f4e405924453db1e315f5d10a2f
Enrichment time
2026-05-13T07:23:57Z
AI-assisted enrichment
Yes

This record may overlap with other records. Its enrichment can be incomplete or wrong, and machine assistance was used. Validate consequential decisions against the linked source and your own environment.