[r/ML] I scaled a pure Spiking Neural Network (SNN) to 1.088B parameters from scratch. Ran out of budget, but here is what I found [R]

Summary

An 18-year-old indie developer successfully scaled a pure Spiking Neural Network (SNN) to 1.088 billion parameters for language modeling, directly training it from scratch. This challenges conventional wisdom that large SNNs fail to converge due to vanishing gradients, achieving a loss of 4.4 before budget constraints halted further training. The work suggests a potential breakthrough in making SNNs viable for large-scale applications without relying on ANN-to-SNN conversion.

Continue Reading

Explore related coverage about community news and adjacent AI developments: [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT, [r/LocalLLaMA] karpathy / autoresearch, [r/ML] KIV: 1M token context window on a RTX 4070 (12GB VRAM), no retraining, drop-in HuggingFace cache replacement - Works with any model that uses DynamicCache [P], [r/ML] LLMs learn backwards, and the scaling hypothesis is bounded. [D].

Related Articles

• [r/ML] [D] MYTHOS-INVERSION STRUCTURAL AUDIT

  March 29, 2026

• [r/LocalLLaMA] karpathy / autoresearch

  March 10, 2026

• [r/ML] KIV: 1M token context window on a RTX 4070 (12GB VRAM), no retraining, drop-in HuggingFace cache replacement - Works with any model that uses DynamicCache [P]

  April 13, 2026

• [r/ML] LLMs learn backwards, and the scaling hypothesis is bounded. [D]

  April 12, 2026