← Optimization & Theory
Deep Learning › Optimization & Theory ›

Neural Network Optimization

902 directly classified papers

Papers per year

Papers

LayerConnect: Hypernetwork-Assisted Inter-Layer Connector to Enhance Parameter Efficiency COLING 2022
Delving Into the Estimation Shift of Batch Normalization in a Network CVPR 2022
Understanding Stochastic Optimization Behavior at the Layer Update Level (Student Abstract) AAAI 2022
Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models EMNLP 2022
Penalizing Gradient Norm for Efficiently Improving Generalization in Deep Learning ICML 2022
Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent ICML 2022
A Unified Weight Initialization Paradigm for Tensorial Convolutional Neural Networks ICML 2022
A Study on the Ramanujan Graph Property of Winning Lottery Tickets ICML 2022
On the Double Descent of Random Features Models Trained with SGD NIPS 2022
Data Selection Curriculum for Neural Machine Translation EMNLP 2022
Power-Law Escape Rate of SGD ICML 2022
Adaptive Accelerated (Extra-)Gradient Methods with Variance Reduction ICML 2022
Forget-free Continual Learning with Winning Subnetworks ICML 2022
Training Your Sparse Neural Network Better with Any Mask ICML 2022
Large-Scale Graph Neural Architecture Search ICML 2022
Zero Stability Well Predicts Performance of Convolutional Neural Networks AAAI 2022
JFB: Jacobian-Free Backpropagation for Implicit Networks AAAI 2022
Detached Error Feedback for Distributed SGD with Random Sparsification ICML 2022
A Computable Definition of the Spectral Bias AAAI 2022
Scaled ReLU Matters for Training Vision Transformers AAAI 2022
Orthogonal Graph Neural Networks AAAI 2022
Proximal PanNet: A Model-Based Deep Network for Pansharpening AAAI 2022
Hyperverlet: A Symplectic Hypersolver for Hamiltonian Systems AAAI 2022
Optimized Potential Initialization for Low-Latency Spiking Neural Networks AAAI 2022
Prior Gradient Mask Guided Pruning-Aware Fine-Tuning AAAI 2022