conftrace_
← Deep Learning
Deep Learning ›

Optimization & Theory

6,829 papers (27 classified directly here)

Subtopics

Model Compression (1,785) Optimization (1,664) Efficient Computing (1,579) Theory (1,082) Neural Network Optimization (903) Evaluation (509) Loss Functions (123) Interpretability (105) Stochastic Methods (97) Regularization (77) Generalization (24) Sparse Optimization (7)

Papers per year

8
50
642
1173
'10
'15
'20
'25

Papers (including subtopics)

Existence and Estimation of Critical Batch Size for Training Generative Adversarial Networks with Two Time-Scale Update Rule ICML 2023
Dissecting the Effects of SGD Noise in Distinct Regimes of Deep Learning ICML 2023
ModelDiff: A Framework for Comparing Learning Algorithms ICML 2023
Cold Analysis of Rao-Blackwellized Straight-Through Gumbel-Softmax Gradient Estimator ICML 2023
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU ICML 2023
Fundamental Limits of Two-layer Autoencoders, and Achieving Them with Gradient Methods ICML 2023
UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers ICML 2023
Long Horizon Temperature Scaling ICML 2023
Gradient Descent in Neural Networks as Sequential Learning in Reproducing Kernel Banach Space ICML 2023
Synthetic data for model selection ICML 2023
The Hessian perspective into the Nature of Convolutional Neural Networks ICML 2023
FedAvg Converges to Zero Training Loss Linearly for Overparameterized Multi-Layer Neural Networks ICML 2023
MODeL: Memory Optimizations for Deep Learning ICML 2023
Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape ICML 2023
Momentum Ensures Convergence of SIGNSGD under Weaker Assumptions ICML 2023
Approximation and Estimation Ability of Transformers for Sequence-to-Sequence Functions with Infinite Dimensional Input ICML 2023
Auto-Differentiation of Relational Computations for Very Large Scale Machine Learning ICML 2023
Dual Focal Loss for Calibration ICML 2023
Perturbation Analysis of Neural Collapse ICML 2023
Beyond In-Domain Scenarios: Robust Density-Aware Calibration ICML 2023
Mimetic Initialization of Self-Attention Layers ICML 2023
Expected Gradients of Maxout Networks and Consequences to Parameter Initialization ICML 2023
Provable Data Subset Selection For Efficient Neural Networks Training ICML 2023
Private Federated Learning with Autotuned Compression ICML 2023
Low-Variance Gradient Estimation in Unrolled Computation Graphs with ES-Single ICML 2023