← Keywords

neural network training

309 papers

Explore in graph

Also known as

DNN NNT

Co-occurring keywords

neural network (6616) neural network optimization (1293) stochastic gradient descent (1088) gradient descent (1143) model compression (3283) deep neural network (1801) stochastic optimization (1060) deep learning (2111) batch normalization (222) non-convex optimization (546)

Papers

Uncertainty-Aware Training of Neural Networks for Selective Medical Image Segmentation MIDL 2020
MetaInit: Initializing learning by learning to initialize NIPS 2019
HyperAdam: A Learnable Task-Adaptive Adam for Network Training AAAI 2019
Energy and Policy Considerations for Deep Learning in NLP ACL 2019
Exponential convergence rates for Batch Normalization: The power of length-direction decoupling in non-convex optimization AISTATS 2019
Ouroboros: On Accelerating Training of Transformer-Based Language Models NIPS 2019
How degenerate is the parametrization of neural networks with the ReLU activation function? NIPS 2019
Learning One-hidden-layer ReLU Networks via Gradient Descent AISTATS 2019
Stochastic Nonconvex Optimization with Large Minibatches ALT 2019
Data-Dependence of Plateau Phenomenon in Learning with Neural Network --- Statistical Mechanical Analysis NIPS 2019
Online Normalization for Training Neural Networks NIPS 2019
A Walkthrough for the Principle of Logit Separation IJCAI 2019
A Restart-based Rank-1 Evolution Strategy for Reinforcement Learning IJCAI 2019
Learning Generalizable Device Placement Algorithms for Distributed Machine Learning NIPS 2019
Regularizing Activation Distribution for Training Binarized Deep Networks CVPR 2019
A General and Adaptive Robust Loss Function CVPR 2019
P2SGrad: Refined Gradients for Optimizing Deep Face Models CVPR 2019
Generalized Batch Normalization: Towards Accelerating Deep Neural Networks AAAI 2019
The Unbearable Weight of Generating Artificial Errors for Grammatical Error Correction ACL 2019
Is artificial data useful for biomedical Natural Language Processing algorithms? ACL 2019
Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules ICML 2019
Beyond Backprop: Online Alternating Minimization with Auxiliary Variables ICML 2019
Robust Video Stabilization by Optimization in CNN Weight Space CVPR 2019
On The Power of Curriculum Learning in Training Deep Networks ICML 2019
An Investigation into Neural Net Optimization via Hessian Eigenvalue Density ICML 2019