Neural Network Optimization

Searching for Search Errors in Neural Morphological Inflection EACL 2021 Second-Order Neural ODE Optimizer NeurIPS 2021 Selectivity considered harmful: evaluating the causal impact of class selectivity in DNNs ICLR 2021 Self-Attention Attribution: Interpreting Information Interactions Inside Transformer AAAI 2021 Self-Guided Curriculum Learning for Neural Machine Translation ACL 2021 Selfish Sparse RNN Training ICML 2021 SGD for Structured Nonconvex Functions: Learning Rates, Minibatching and Interpolation AISTATS 2021 Shape Matters: Understanding the Implicit Bias of the Noise Covariance COLT 2021 Shuffling Recurrent Neural Networks AAAI 2021 Simple and Effective Stochastic Neural Networks AAAI 2021 Simpler Certified Radius Maximization by Propagating Covariances CVPR 2021 SKFAC: Training Neural Networks With Faster Kronecker-Factored Approximate Curvature CVPR 2021 Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstruction NeurIPS 2021 SmBoP: Semi-autoregressive Bottom-up Semantic Parsing ACL 2021 SmBoP: Semi-autoregressive Bottom-up Semantic Parsing NAACL 2021 SMG: A Shuffling Gradient-Based Method with Momentum ICML 2021 Sparse Deep Learning: A New Framework Immune to Local Traps and Miscalibration NeurIPS 2021 Spectral Normalisation for Deep Reinforcement Learning: An Optimisation Perspective ICML 2021 Spherical Motion Dynamics: Learning Dynamics of Normalized Neural Network using SGD and Weight Decay NeurIPS 2021 Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothness ICML 2021 Stability and Generalization of Decentralized Stochastic Gradient Descent AAAI 2021 Stability & Generalisation of Gradient Descent for Shallow Neural Networks without the Neural Tangent Kernel NeurIPS 2021 Stabilizing Equilibrium Models by Jacobian Regularization ICML 2021 Stable ResNet AISTATS 2021 State-Aware Value Function Approximation with Attention Mechanism for Restless Multi-armed Bandits IJCAI 2021