loss landscape

Truth or backpropaganda? An empirical investigation of deep learning theory ICLR 2020 Understanding Architectures Learnt by Cell-based Neural Architecture Search ICLR 2020 Unique Properties of Flat Minima in Deep Networks ICML 2020 What is being transferred in transfer learning? NeurIPS 2020 Addressing the Loss-Metric Mismatch with Adaptive Loss Alignment ICML 2019 Explaining Landscape Connectivity of Low-cost Solutions for Multilayer Nets NeurIPS 2019 Exponential convergence rates for Batch Normalization: The power of length-direction decoupling in non-convex optimization AISTATS 2019 Finding the Needle in the Haystack with Convolutions: on the benefits of architectural bias NeurIPS 2019 Fluctuation-dissipation relations for stochastic gradient descent ICLR 2019 Interpreting and Evaluating Neural Network Robustness IJCAI 2019 Large Scale Structure of Neural Network Loss Landscapes NeurIPS 2019 Learning One-hidden-layer Neural Networks under General Input Distributions AISTATS 2019 On Connected Sublevel Sets in Deep Learning ICML 2019 On the loss landscape of a class of deep neural networks with no bad local valleys ICLR 2019 Robustness via Curvature Regularization, and Vice Versa CVPR 2019 Semi-flat minima and saddle points by embedding neural networks to overparameterization NeurIPS 2019 Spurious Valleys in One-hidden-layer Neural Network Optimization Landscapes JMLR 2019 The Goldilocks Zone: Towards Better Understanding of Neural Network Loss Landscapes AAAI 2019 The Normalization Method for Alleviating Pathological Sharpness in Wide Neural Networks NeurIPS 2019 Visualizing and Understanding the Effectiveness of BERT EMNLP 2019 Adding One Neuron Can Eliminate All Bad Local Minima NeurIPS 2018 Comparing Dynamics: Deep Neural Networks versus Glassy Systems ICML 2018 Optimization Landscape and Expressivity of Deep CNNs ICML 2018 Skip Connections Eliminate Singularities ICLR 2018 Visualizing the Loss Landscape of Neural Nets NeurIPS 2018