Is Mamba Capable of In-Context Learning?

Riccardo Grazzi; Julien Niklas Siems; Simon Schrodi; Thomas Brox; Frank Hutter

2024 AutoML AutoML 2024

Is Mamba Capable of In-Context Learning?

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

❓ The Questioner

Authors

Riccardo Grazzi, Julien Niklas Siems, Simon Schrodi, Thomas Brox, Frank Hutter

Topics

Artificial Intelligence > Core AI > Foundation Models Machine Learning > Core Methods > Representation Learning Deep Learning > Architectures > Transformers

Keywords

natural language processing in-context learning transformer generalization state space model mamba

Download PDF