[r/ML] [D] Howcome Muon is only being used for Transformers?

Summary

Muon, a training technique, has been rapidly adopted for Large Language Model (LLM) training using Transformers, yet its application in other contexts like Convolutional Neural Networks (ConvNets) is surprisingly limited. Despite initial reports of achieving training speed records on datasets like Cifar-10, its absence elsewhere raises questions about its scalability and broader applicability. The discussion seeks to understand why Muon's use seems confined to Transformers.

Continue Reading

Explore related coverage about community news and adjacent AI developments: [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT, [r/LocalLLaMA] karpathy / autoresearch, [r/ML] [R] Agentic AI and Occupational Displacement: A Multi-Regional Task Exposure Analysis (236 occupations, 5 US metros), [r/ML] Building behavioural response models of public figures using Brain scan data (Predict their next move using psychological modelling) [P].

Related Articles

• [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT

  March 29, 2026

• [r/LocalLLaMA] karpathy / autoresearch

  March 10, 2026

• [r/ML] [R] Agentic AI and Occupational Displacement: A Multi-Regional Task Exposure Analysis (236 occupations, 5 US metros)

  April 7, 2026

• [r/ML] Building behavioural response models of public figures using Brain scan data (Predict their next move using psychological modelling) [P]

  April 5, 2026