conftrace_
← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3,648 papers

Papers per year

Papers

Multi-Grained Knowledge Distillation for Named Entity Recognition NAACL 2021
Align, then memorise: the dynamics of learning with feedback alignment ICML 2021
On Training Implicit Models NIPS 2021
On Monotonic Linear Interpolation of Neural Network Parameters ICML 2021
Differentiable Multiple Shooting Layers NIPS 2021
Momentum Centering and Asynchronous Update for Adaptive Gradient Methods NIPS 2021
Phase Diagram for Two-layer ReLU Neural Networks at Infinite-width Limit JMLR 2021
Improving Anytime Prediction with Parallel Cascaded Networks and a Temporal-Difference Loss NIPS 2021
Network-to-Network Regularization: Enforcing Occam's Razor to Improve Generalization NIPS 2021
Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothness ICML 2021
ERNIE-Doc: A Retrospective Long-Document Modeling Transformer ACL 2021
Analytic Study of Families of Spurious Minima in Two-Layer ReLU Neural Networks: A Tale of Symmetry II NIPS 2021
Evaluating Neural Model Robustness for Machine Comprehension EACL 2021
RG PA at SemEval-2021 Task 1: A Contextual Attention-based Model with RoBERTa for Lexical Complexity Prediction ACL 2021
Randomized Deep Structured Prediction for Discourse-Level Processing EACL 2021
Learning Neural Network Subspaces ICML 2021
Differentiable Surface Rendering via Non-Differentiable Sampling ICCV 2021
Learning with Generated Teammates to Achieve Type-Free Ad-Hoc Teamwork IJCAI 2021
A Novel Method to Solve Neural Knapsack Problems ICML 2021
On the Explicit Role of Initialization on the Convergence and Implicit Bias of Overparametrized Linear Networks ICML 2021
Spherical Motion Dynamics: Learning Dynamics of Normalized Neural Network using SGD and Weight Decay NIPS 2021
Coupled Gradient Estimators for Discrete Latent Variables NIPS 2021
Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces ICCV 2021
Augmented Shortcuts for Vision Transformers NIPS 2021
High-Performance Large-Scale Image Recognition Without Normalization ICML 2021