conftrace_
← Deep Learning
Deep Learning ›

Optimization & Theory

6,829 papers (27 classified directly here)

Subtopics

Model Compression (1,785) Optimization (1,664) Efficient Computing (1,579) Theory (1,082) Neural Network Optimization (903) Evaluation (509) Loss Functions (123) Interpretability (105) Stochastic Methods (97) Regularization (77) Generalization (24) Sparse Optimization (7)

Papers per year

8
50
642
1173
'10
'15
'20
'25

Papers (including subtopics)

Load What You Need: Smaller Versions of Mutililingual BERT EMNLP 2020
SqueezeBERT: What can computer vision teach NLP about efficient neural networks? EMNLP 2020
FastFormers: Highly Efficient Transformer Models for Natural Language Understanding EMNLP 2020
Overview of the SustaiNLP 2020 Shared Task EMNLP 2020
Addressing Exposure Bias With Document Minimum Risk Training: Cambridge at the WMT20 Biomedical Translation Task EMNLP 2020
Communication-Efficient Distributed Stochastic AUC Maximization with Deep Neural Networks ICML 2020
Training Binary Neural Networks through Learning with Noisy Supervision ICML 2020
The Tree Ensemble Layer: Differentiability meets Conditional Computation ICML 2020
Dynamics of Deep Neural Networks and Neural Tangent Hierarchy ICML 2020
Curvature-corrected learning dynamics in deep neural networks ICML 2020
Do We Need Zero Training Loss After Achieving Zero Training Error? ICML 2020
Information-Theoretic Local Minima Characterization and Regularization ICML 2020
Associative Memory in Iterated Overparameterized Sigmoid Autoencoders ICML 2020
Guided Learning of Nonconvex Models through Successive Functional Gradient Optimization ICML 2020
Operation-Aware Soft Channel Pruning using Differentiable Masks ICML 2020
Soft Threshold Weight Reparameterization for Learnable Sparsity ICML 2020
Efficient Proximal Mapping of the 1-path-norm of Shallow Networks ICML 2020
SGD Learns One-Layer Networks in WGANs ICML 2020
Fine-Grained Analysis of Stability and Generalization for Stochastic Gradient Descent ICML 2020
Manifold Identification for Ultimately Communication-Efficient Distributed Optimization ICML 2020
Neural Architecture Search in A Proxy Validation Loss Landscape ICML 2020
Time-aware Large Kernel Convolutions ICML 2020
Finding trainable sparse networks through Neural Tangent Transfer ICML 2020
Error Estimation for Sketched SVD via the Bootstrap ICML 2020
A Mean Field Analysis Of Deep ResNet And Beyond: Towards Provably Optimization Via Overparameterization From Depth ICML 2020