conftrace_
← Optimization & Theory
Deep Learning › Optimization & Theory ›

Neural Network Optimization

903 papers

Papers per year

2
9
127
100
'10
'15
'20
'25

Papers

A Unified Weight Initialization Paradigm for Tensorial Convolutional Neural Networks ICML 2022
Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent ICML 2022
Detached Error Feedback for Distributed SGD with Random Sparsification ICML 2022
Penalizing Gradient Norm for Efficiently Improving Generalization in Deep Learning ICML 2022
CAT: Customized Adversarial Training for Improved Robustness IJCAI 2022
Doubly Sparse Asynchronous Learning for Stochastic Composite Optimization IJCAI 2022
A Sparse-Motif Ensemble Graph Convolutional Network against Over-smoothing IJCAI 2022
Multi-Level Firing with Spiking DS-ResNet: Enabling Better and Deeper Directly-Trained Spiking Neural Networks IJCAI 2022
DF-ResNet: Boosting Speaker Verification Performance with Depth-First Design INTERSPEECH 2022
NAS-VAD: Neural Architecture Search for Voice Activity Detection INTERSPEECH 2022
A Momentumized, Adaptive, Dual Averaged Gradient Method JMLR 2022
Interlocking Backpropagation: Improving depthwise model-parallelism JMLR 2022
Learning Rates as a Function of Batch Size: A Random Matrix Theory Approach to Neural Network Training JMLR 2022
Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration JMLR 2022
Probing via Prompting NAACL 2022
Don’t Take It Literally: An Edit-Invariant Sequence Loss for Text Generation NAACL 2022
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline NAACL 2022
Adversarial Branch Architecture Search for Unsupervised Domain Adaptation WACV 2022
Numerical influence of ReLU’(0) on backpropagation NIPS 2021
Zero Time Waste: Recycling Predictions in Early Exit Neural Networks NIPS 2021
Demystifying and Generalizing BinaryConnect NIPS 2021
On Linear Stability of SGD and Input-Smoothness of Neural Networks NIPS 2021
The Implicit Bias of Minima Stability: A View from Function Space NIPS 2021
Heavy Ball Neural Ordinary Differential Equations NIPS 2021
Particle Dual Averaging: Optimization of Mean Field Neural Network with Global Convergence Rate Analysis NIPS 2021