← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3648 directly classified papers

Papers per year

Papers

Self-Orthogonality Module: A Network Architecture Plug-in for Learning Orthogonal Filters WACV 2020
Convergence Rates of a Momentum Algorithm with Bounded Adaptive Step Size for Nonconvex Optimization ACML 2020
Stochastic Gauss-Newton Algorithms for Nonconvex Compositional Optimization ICML 2020
Towards Adaptive Residual Network Training: A Neural-ODE Perspective ICML 2020
Complexity of Finding Stationary Points of Nonconvex Nonsmooth Functions ICML 2020
Orthogonalized SGD and Nested Architectures for Anytime Neural Networks ICML 2020
DropNet: Reducing Neural Network Complexity via Iterative Pruning ICML 2020
Deep Reinforcement Learning with Population-Coded Spiking Neural Network for Continuous Control CORL 2020
Low Bias Low Variance Gradient Estimates for Boolean Stochastic Networks ICML 2020
Finding trainable sparse networks through Neural Tangent Transfer ICML 2020
Neuro-Symbolic Program Search for Autonomous Driving Decision Module Design CORL 2020
Soft Multicopter Control Using Neural Dynamics Identification CORL 2020
Efficient Proximal Mapping of the 1-path-norm of Shallow Networks ICML 2020
Towards a General Theory of Infinite-Width Limits of Neural Classifiers ICML 2020
Training Linear Neural Networks: Non-Local Convergence and Complexity Results ICML 2020
Towards Understanding the Dynamics of the First-Order Adversaries ICML 2020
Better depth-width trade-offs for neural networks through the lens of dynamical systems ICML 2020
Dilated Convolutional Attention Network for Medical Code Assignment from Clinical Text EMNLP 2020
Empirical Study of the Benefits of Overparameterization in Learning Latent Variable Models ICML 2020
Winnowing with Gradient Descent COLT 2020
Second-Order Information in Non-Convex Stochastic Optimization: Power and Limitations COLT 2020
Complexity Guarantees for Polyak Steps with Momentum COLT 2020
Faster Projection-free Online Learning COLT 2020
Beyond Signal Propagation: Is Feature Diversity Necessary in Deep Neural Network Initialization? ICML 2020
Taylor Expansion Policy Optimization ICML 2020