Beyond Induction Heads: In-Context Meta Learning Induces Multi-Phase Circuit Emergence

Gouki Minegishi; Hiroki Furuta; Shohei Taniguchi; Yusuke Iwasawa; Yutaka Matsuo

2025 ICML ICML 2025

Beyond Induction Heads: In-Context Meta Learning Induces Multi-Phase Circuit Emergence

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Natural Language Processing

Authors

Gouki Minegishi, Hiroki Furuta, Shohei Taniguchi, Yusuke Iwasawa, Yutaka Matsuo

Topics

Natural Language Processing > Applications > Question Answering Machine Learning > Learning Types > Transfer Learning Artificial Intelligence > Core AI > Large Language Models

Keywords

induction head contextual adaptation task inference large language model in-context meta-learning multi-phase circuit emergence

Download PDF