conftrace_
← Deep Learning
Deep Learning ›

Optimization & Theory

6,829 papers (27 classified directly here)

Subtopics

Model Compression (1,785) Optimization (1,664) Efficient Computing (1,579) Theory (1,082) Neural Network Optimization (903) Evaluation (509) Loss Functions (123) Interpretability (105) Stochastic Methods (97) Regularization (77) Generalization (24) Sparse Optimization (7)

Papers per year

8
50
642
1173
'10
'15
'20
'25

Papers (including subtopics)

Consistency Regularization for Certified Robustness of Smoothed Classifiers NIPS 2020
Non-Euclidean Universal Approximation NIPS 2020
Sharp Representation Theorems for ReLU Networks with Precise Dependence on Depth NIPS 2020
Efficient Projection-free Algorithms for Saddle Point Problems NIPS 2020
GAIT-prop: A biologically plausible learning rule derived from backpropagation of error NIPS 2020
SCOP: Scientific Control for Reliable Neural Network Pruning NIPS 2020
Understanding Double Descent Requires A Fine-Grained Bias-Variance Decomposition NIPS 2020
Hybrid Variance-Reduced SGD Algorithms For Minimax Problems with Nonconvex-Linear Function NIPS 2020
TinyTL: Reduce Memory, Not Parameters for Efficient On-Device Learning NIPS 2020
Winning the Lottery with Continuous Sparsification NIPS 2020
An implicit function learning approach for parametric modal regression NIPS 2020
Learning to solve TV regularised problems with unrolled algorithms NIPS 2020
In search of robust measures of generalization NIPS 2020
A shooting formulation of deep learning NIPS 2020
Counterexample-Guided Learning of Monotonic Neural Networks NIPS 2020
Neural Architecture Generator Optimization NIPS 2020
Deeply Learned Spectral Total Variation Decomposition NIPS 2020
FracTrain: Fractionally Squeezing Bit Savings Both Temporally and Spatially for Efficient DNN Training NIPS 2020
Generalization error in high-dimensional perceptrons: Approaching Bayes error with convex optimization NIPS 2020
Kernel Based Progressive Distillation for Adder Neural Networks NIPS 2020
Escaping Saddle-Point Faster under Interpolation-like Conditions NIPS 2020
Instead of Rewriting Foreign Code for Machine Learning, Automatically Synthesize Fast Gradients NIPS 2020
The phase diagram of approximation rates for deep neural networks NIPS 2020
On Infinite-Width Hypernetworks NIPS 2020
Intra Order-preserving Functions for Calibration of Multi-Class Neural Networks NIPS 2020