weight normalization

Gradient Weight-normalized Low-rank Projection for Efficient LLM Training AAAI 2025 Scalable Optimization in the Modular Norm NeurIPS 2024 Deep Hybrid Models for Out-of-Distribution Detection CVPR 2022 On the Stability and Scalability of Node Perturbation Learning NeurIPS 2022 Optimized Potential Initialization for Low-Latency Spiking Neural Networks AAAI 2022 Aligned Structured Sparsity Learning for Efficient Image Super-Resolution NeurIPS 2021 Constrained Weight Optimization for Learning Without Activation Normalization WACV 2021 Expressive 1-Lipschitz Neural Networks for Robust Multiple Graph Learning against Adversarial Attacks ICML 2021 Towards a unified framework for fair and stable graph representation learning UAI 2021 Towards Stable and Robust AdderNets NeurIPS 2021 Additive Powers-of-Two Quantization: An Efficient Non-uniform Discretization for Neural Networks ICLR 2020 Adversarial Lipschitz Regularization ICLR 2020 Graph Neural Networks Exponentially Lose Expressive Power for Node Classification ICLR 2020 Implicit Regularization and Convergence for Weight Normalization NeurIPS 2020 New Interpretations of Normalization Methods in Deep Learning AAAI 2020 Optimization Theory for ReLU Neural Networks Trained with Normalization Layers ICML 2020 Stable Rank Normalization for Improved Generalization in Neural Networks and GANs ICLR 2020 Understanding the Disharmony between Weight Normalization Family and Weight Decay AAAI 2020 Equi-normalization of Neural Networks ICLR 2019 Fine-grained Optimization of Deep Neural Networks NeurIPS 2019 How to Initialize your Network? Robust Initialization for WeightNorm & ResNets NeurIPS 2019 Inherent Weight Normalization in Stochastic Neural Networks NeurIPS 2019 Normalization Helps Training of Quantized LSTM NeurIPS 2019 Theoretical Investigation of Generalization Bound for Residual Networks IJCAI 2019 Fine-tuning on Clean Data for End-to-End Speech Translation: FBK @ IWSLT 2018 EMNLP 2018