Skip to content
conftrace_
2024 ICML ICML 2024

Mechanistic Design and Scaling of Hybrid Architectures

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

🐣 Hot Topic Early Bird - sparsity

Authors

Michael Poli, Armin W Thomas, Eric Nguyen, Pragaash Ponnusamy, Björn Deiseroth, Kristian Kersting, Taiji Suzuki, Brian Hie, Stefano Ermon, Christopher Re, Ce Zhang, Stefano Massaroli

Topics

Artificial Intelligence > Core AI > Foundation Models Machine Learning > Application Areas > Efficient Computing Deep Learning > Architectures > Transformers

Keywords

sparsity scaling law mamba hybridization hyena transformer++
Download PDF