Hide & Seek: Transformer Symmetries Obscure Sharpness & Riemannian Geometry Finds It

Marvin F. Da Silva; Felix Dangel; Sageev Oore

2025 ICML ICML 2025

Hide & Seek: Transformer Symmetries Obscure Sharpness & Riemannian Geometry Finds It

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Marvin F. Da Silva, Felix Dangel, Sageev Oore

Topics

Machine Learning > Optimization & Theory > Learning Theory Machine Learning > Optimization & Theory > Optimization Deep Learning > Architectures > Transformers

Keywords

generalization higher-order term quotient manifold geodesic ball sharpness transformer symmetries

Download PDF