gradient normalization

Gradient Weight-normalized Low-rank Projection for Efficient LLM Training AAAI 2025 Momentum-Driven Adaptivity: Towards Tuning-Free Asynchronous Federated Learning ICML 2025 Revisiting Gradient Normalization and Clipping for Nonconvex SGD under Heavy-Tailed Noise: Necessity, Sufficiency, and Acceleration JMLR 2025 WaveLoss: An Adaptive Dynamic Loss for Deep Gait Recognition AAAI 2025 BranchNorm: Robustly Scaling Extremely Deep Transformers ACL 2024 Enhancing Transferable Adversarial Attacks on Vision Transformers through Gradient Normalization Scaling and High-Frequency Adaptation ICLR 2024 NICE: NoIse-modulated Consistency rEgularization for Data-Efficient GANs NeurIPS 2023 Practical Sharpness-Aware Minimization Cannot Converge All the Way to Optima NeurIPS 2023 Constructing Orthogonal Convolutions in an Explicit Manner ICLR 2022 GraN-GAN: Piecewise Gradient Normalization for Generative Adversarial Networks WACV 2022 Orthogonal Graph Neural Networks AAAI 2022 Gradient Normalization for Generative Adversarial Networks ICCV 2021 Rebooting ACGAN: Auxiliary Classifier GANs with Stable Training NeurIPS 2021 Bayesian filtering unifies adaptive and non-adaptive neural network optimization methods NeurIPS 2020 Understanding and Improving Layer Normalization NeurIPS 2019 GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks ICML 2018 Improving Regression Performance with Distributional Losses ICML 2018 Accumulated Gradient Normalization ACML 2017