All Topics
Topic
transformers
2 articles
Energy-Based Transformers: The 1982 Architecture Finally Got Compatible Training Tricks
An EBM finally crossed 800M parameters without collapsing. Nobody has independently reproduced the 35% scaling claim. Both halves matter.
deep-learningai-architecture
May 07, 2026
·deep-learningai-architectureThe Post-Transformer Era: State Space Models, Mamba, and What Comes After Attention
A practitioner's guide to Mamba and State Space Models — how selective state spaces achieve linear scaling, when to use SSMs vs Transformers vs hybrids, and production-ready models.
mambaai-architecture
February 10, 2026
·mambaai-architecture