Neural Network Optimization

Accelerating Neural Architecture Search via Proxy Data IJCAI 2021 Acceleration via Fractal Learning Rate Schedules ICML 2021 ACMo: Angle-Calibrated Moment Methods for Stochastic Optimization AAAI 2021 A Convergence Analysis of Gradient Descent on Graph Neural Networks NeurIPS 2021 Acoustic Echo Cancellation with Cross-Domain Learning Interspeech 2021 Activate or Not: Learning Customized Activation CVPR 2021 ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning AAAI 2021 AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights ICLR 2021 Adaptive First-Order Methods Revisited: Convex Minimization without Lipschitz Requirements NeurIPS 2021 Adaptive Proximal Gradient Methods for Structured Neural Networks NeurIPS 2021 AdaTag: Multi-Attribute Value Extraction from Product Profiles with Adaptive Decoding ACL 2021 Addressing the Vulnerability of NMT in Input Perturbations NAACL 2021 A Deep Conditioning Treatment of Neural Networks ALT 2021 A Deeper Look at the Hessian Eigenspectrum of Deep Neural Networks and its Applications to Regularization AAAI 2021 AdvantageNAS: Efficient Neural Architecture Search with Credit Assignment AAAI 2021 A Dynamical View on Optimization Algorithms of Overparameterized Neural Networks AISTATS 2021 A Fast and Robust Method for Global Topological Functional Optimization AISTATS 2021 Affine Invariant Analysis of Frank-Wolfe on Strongly Convex Sets ICML 2021 A Flexible Framework for Communication-Efficient Machine Learning AAAI 2021 A Large-scale Evaluation of Neural Machine Transliteration for Indic Languages EACL 2021 Aligned Structured Sparsity Learning for Efficient Image Super-Resolution NeurIPS 2021 Align, then memorise: the dynamics of learning with feedback alignment ICML 2021 A Local Convergence Theory for Mildly Over-Parameterized Two-Layer Neural Network COLT 2021 A Low-Cost Compliant Gripper Using Cooperative Mini-Delta Robots for Dexterous Manipulation RSS 2021 AMEIR: Automatic Behavior Modeling, Interaction Exploration and MLP Investigation in the Recommender System IJCAI 2021