Skip to content
conftrace_
2025 ICML ICML 2025

Peri-LN: Revisiting Normalization Layer in the Transformer Architecture

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Natural Language Processing

Authors

Jeonghoon Kim, Byeongchan Lee, Cheonbok Park, Yeontaek Oh, Beomjun Kim, Taehwan Yoo, Seongjin Shin, Dongyoon Han, Jinwoo Shin, Kang Min Yoo

Topics

Machine Learning > Core Methods > Representation Learning Natural Language Processing > Resources & Methods > Large Language Models Artificial Intelligence > Core AI > Large Language Models

Keywords

layer normalization gradient propagation activation variance peri-ln post-ln pre-ln
Download PDF