SPIN Unprocessed October 23, 2026 ai_technology research
A Quadratic Lens on Muon's Polar Update: Benefits, Pitfalls, and the Role of Newton-Schulz
View original on arxiv.orgOverview
arXiv:2610.30280v1 Announce Type: new Abstract: Muon updates matrix-valued parameters along approximately orthogonalized directions and often trains large language models faster than AdamW, yet it remains unclear when and why orthogonalization helps. We study PolarGD, the orthogonalized update at the core of Muon, on matrix quadratics, where optimizers can be analyzed in closed form, and compare update directions under line search to remove the effect of learning-rate tuning. Orthogonalization p
SpinGraph analysis pending — check back after processing.
Ask AI about this story
Opens with the SpinGraph .md URL and structured context — one click, prompt included.
More from arXiv Machine Learning
View all →- AcoustiPrint: Physics-Guided Neural Design of Manufacturable Acoustic Structures
- Escaping the Phylogenetic Trap: Persistent Homology Enables Cross-Species Ion Channel Classification via Multimodal Graph Neural Networks
- Bayesian Fixed-Confidence Best-Arm Identification with Abstention
- Probing and Steering for Safety-Relevant Behaviours in Large Language Models
- CTRL-FM: Inference-Time Structural Control for Flow-Based Virtual Sensing under Long-Horizon Node Outages
- Spike-Aware Gradient-Based Mixed-Precision Quantization of Spiking Neural Networks for Vision Applications
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO