Self-Improving Transformers Overcome Easy-to-Hard and Length Generalization Challenges

Nayoung Lee; Ziyang Cai; Avi Schwarzschild; Kangwook Lee; Dimitris Papailiopoulos

2025 ICML ICML 2025

Self-Improving Transformers Overcome Easy-to-Hard and Length Generalization Challenges

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Nayoung Lee, Ziyang Cai, Avi Schwarzschild, Kangwook Lee, Dimitris Papailiopoulos

Topics

Artificial Intelligence > Core AI > Foundation Models Machine Learning > Learning Types > Self-Supervised Learning Artificial Intelligence > Core AI > Large Language Models

Keywords

transformer generalization self improvement pretrained curriculum weak-to-strong

Download PDF