conftrace_

layer normalization

65 papers

Explore in graph

Also known as

LN LAYERNORM

Co-occurring keywords

batch normalization (222) neural network optimization (1293) neural network (6616) group normalization (13) transformer architecture (1560) deep neural network (1803) attention mechanism (4001) residual connection (55) transformer model (1996) model optimization (75)

Papers

Geometric Interpretation of Layer Normalization and a Comparative Analysis with RMSNorm EACL 2026
Revisiting Layer Normalization for Point Cloud Test Time Adaptation WACV 2026
Deepfake Detection that Generalizes Across Benchmarks WACV 2026
On the Mathematical Relationship Between Layer Normalization and Dynamic Activation Functions EACL 2026
LayerAct: Advanced Activation Mechanism for Robust Inference of CNNs AAAI 2025
Dynamic Group Normalization: Spatio-Temporal Adaptation to Evolving Data Statistics CVPR 2025
Transformers without Normalization CVPR 2025
Maximizing the Position Embedding for Vision Transformers with Global Average Pooling AAAI 2025
On the Role of Attention Masks and LayerNorm in Transformers NIPS 2024
BranchNorm: Robustly Scaling Extremely Deep Transformers ACL 2024
Conformer-Based Speech Recognition On Extreme Edge-Computing Devices NAACL 2024
Alleviating Distortion in Image Generation via Multi-Resolution Diffusion Models and Time-Dependent Layer Normalization NIPS 2024
MambaLLIE: Implicit Retinex-Aware Low Light Enhancement with Global-then-Local State Space NIPS 2024
Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers NIPS 2024
Transformers on Markov data: Constant depth suffices NIPS 2024
Strong Baselines for Parameter-Efficient Few-Shot Fine-Tuning AAAI 2024
MoEUT: Mixture-of-Experts Universal Transformers NIPS 2024
StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesis AAAI 2024
Improving Personalized Sentiment Representation with Knowledge-enhanced and Parameter-efficient Layer Normalization COLING 2024
Comparing the Decision-Making Mechanisms by Transformers and CNNs via Explanation Methods CVPR 2024
Confidence Regulation Neurons in Language Models NIPS 2024
Pre-RMSNorm and Pre-CRMSNorm Transformers: Equivalent and Efficient Pre-LN Transformers NIPS 2023
Brainformers: Trading Simplicity for Efficiency ICML 2023
Stabilizing Transformer Training by Preventing Attention Entropy Collapse ICML 2023
LaPE: Layer-adaptive Position Embedding for Vision Transformers with Independent Layer Normalization ICCV 2023