← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3648 directly classified papers

Papers per year

Papers

Disentangling Trainability and Generalization in Deep Neural Networks ICML 2020
PowerNorm: Rethinking Batch Normalization in Transformers ICML 2020
Learning To Stop While Learning To Predict ICML 2020
Uncertainty-Aware Lookahead Factor Models for Quantitative Investing ICML 2020
Two Routes to Scalable Credit Assignment without Weight Symmetry ICML 2020
Linear Mode Connectivity and the Lottery Ticket Hypothesis ICML 2020
Fractional Underdamped Langevin Dynamics: Retargeting SGD with Momentum under Heavy-Tailed Gradient Noise ICML 2020
SoftSort: A Continuous Relaxation for the argsort Operator ICML 2020
Nesterov's Acceleration for Approximate Newton JMLR 2020
On Convergence-Diagnostic based Step Sizes for Stochastic Gradient Descent ICML 2020
Einsum Networks: Fast and Scalable Learning of Tractable Probabilistic Circuits ICML 2020
Acceleration through spectral density estimation ICML 2020
Nonlinear Residual Echo Suppression Using a Recurrent Neural Network INTERSPEECH 2020
A New Training Pipeline for an Improved Neural Transducer INTERSPEECH 2020
New Insights and Perspectives on the Natural Gradient Method JMLR 2020
Joint Detection of Sentence Stress and Phrase Boundary for Prosody INTERSPEECH 2020
An Effective Perturbation Based Semi-Supervised Learning Method for Sound Event Detection INTERSPEECH 2020
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates ICML 2020
A simpler approach to accelerated optimization: iterative averaging meets optimism ICML 2020
Cooperative Initialization based Deep Neural Network Training WACV 2020
End-to-End ASR with Adaptive Span Self-Attention INTERSPEECH 2020
Quantization Aware Training with Absolute-Cosine Regularization for Automatic Speech Recognition INTERSPEECH 2020
Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropout NIPS 2020
Learning to Branch for Multi-Task Learning ICML 2020
Enhancing Monotonicity for Robust Autoregressive Transformer TTS INTERSPEECH 2020