When can in-context learning generalize out of task distribution?

Chase Goddard; Lindsay M. Smith; Vudtiwat Ngampruetikorn; David J. Schwab

2025 ICML ICML 2025

When can in-context learning generalize out of task distribution?

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

❓ The Questioner

Authors

Chase Goddard, Lindsay M. Smith, Vudtiwat Ngampruetikorn, David J. Schwab

Topics

Machine Learning > Optimization & Theory > Learning Theory Machine Learning > Learning Types > Transfer Learning Artificial Intelligence > Core AI > Large Language Models

Keywords

in-context learning generalization task diversity pre-trained transformer regression problem phase diagram

Download PDF