conftrace_

gradient norm

39 papers

Explore in graph

Also known as

GRADNORM GNS

Co-occurring keywords

neural network optimization (1293) stochastic gradient descent (1091) convex optimization (1321) non-convex optimization (547) model generalization (190) flat minima (50) neural network (6616) convergence rate (607) gradient descent (1144) sharpness-aware minimization (81)

Papers

Optimization and Robustness-Informed Membership Inference Attacks for LLMs AAAI 2026
Asymptotic Unbiased Sample Sampling to Speed Up Sharpness-Aware Minimization AAAI 2025
Beyond Losses Reweighting: Empowering Multi-Task Learning via the Generalization Perspective ICCV 2025
Efficient Layer-wise LLM Fine-tuning for Revision Intention Prediction EMNLP 2025
FedMIA: An Effective Membership Inference Attack Exploiting "All for One" Principle in Federated Learning CVPR 2025
When Should Dense Retrievers Be Updated in Evolving Corpora? Detecting Out-of-Distribution Corpora Using GradNormIR ACL 2025
PACE: Marrying generalization in PArameter-efficient fine-tuning with Consistency rEgularization NIPS 2024
Unveiling and Mitigating Backdoor Vulnerabilities based on Unlearning Weight Changes and Backdoor Activeness NIPS 2024
GRAWA: Gradient-based Weighted Averaging for Distributed Training of Deep Learning Models AISTATS 2024
Clarifying the Behavior and the Difficulty of Adversarial Training AAAI 2024
FedGTST: Boosting Global Transferability of Federated Models via Statistics Tuning NIPS 2024
Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization CVPR 2023
Initialization Matters: Privacy-Utility Analysis of Overparameterized Neural Networks NIPS 2023
Boosting Adversarial Transferability by Achieving Flat Local Maxima NIPS 2023
Two Sides of One Coin: the Limits of Untuned SGD and the Power of Adaptive Methods NIPS 2023
On the Overlooked Pitfalls of Weight Decay and How to Mitigate Them: A Gradient-Norm Perspective NIPS 2023
AdaNorm: Adaptive Gradient Norm Correction Based Optimizer for CNNs WACV 2023
Time-Reversed Dissipation Induces Duality Between Minimizing Gradient Norm and Function Value NIPS 2023
Penalizing Gradient Norm for Efficiently Improving Generalization in Deep Learning ICML 2022
Boosting Active Learning via Improving Test Performance AAAI 2022
Oracle Complexity in Nonsmooth Nonconvex Optimization JMLR 2022
Sandwich Batch Normalization: A Drop-In Replacement for Feature Distribution Heterogeneity WACV 2022
On the Importance of Gradient Norm in PAC-Bayesian Bounds NIPS 2022
Temporal Effective Batch Normalization in Spiking Neural Networks NIPS 2022
Practical Schemes for Finding Near-Stationary Points of Convex Finite-Sums AISTATS 2022