conftrace_
← Deep Learning
Deep Learning ›

Optimization & Theory

6,829 papers (27 classified directly here)

Subtopics

Model Compression (1,785) Optimization (1,664) Efficient Computing (1,579) Theory (1,082) Neural Network Optimization (903) Evaluation (509) Loss Functions (123) Interpretability (105) Stochastic Methods (97) Regularization (77) Generalization (24) Sparse Optimization (7)

Papers per year

8
50
642
1173
'10
'15
'20
'25

Papers (including subtopics)

Separable Physics-Informed Neural Networks NIPS 2023
Improved Convergence in High Probability of Clipped Gradient Methods with Heavy Tailed Noise NIPS 2023
Provable Advantage of Curriculum Learning on Parity Targets with Mixed Inputs NIPS 2023
Transformers learn through gradual rank increase NIPS 2023
Global Convergence Analysis of Local SGD for Two-layer Neural Network without Overparameterization NIPS 2023
Most Neural Networks Are Almost Learnable NIPS 2023
Gaussian Mixture Solvers for Diffusion Models NIPS 2023
Train Faster, Perform Better: Modular Adaptive Training in Over-Parameterized Models NIPS 2023
No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models NIPS 2023
Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets NIPS 2023
Every Parameter Matters: Ensuring the Convergence of Federated Learning with Dynamic Heterogeneous Models Reduction NIPS 2023
Small batch deep reinforcement learning NIPS 2023
Practical Sharpness-Aware Minimization Cannot Converge All the Way to Optima NIPS 2023
Adaptive SGD with Polyak stepsize and Line-search: Robust Convergence and Variance Reduction NIPS 2023
On the Ability of Graph Neural Networks to Model Interactions Between Vertices NIPS 2023
The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networks NIPS 2023
Landscape Surrogate: Learning Decision Losses for Mathematical Optimization Under Partial Information NIPS 2023
Energy Transformer NIPS 2023
Theoretical and Practical Perspectives on what Influence Functions Do NIPS 2023
On Sparse Modern Hopfield Model NIPS 2023
Certification of Distributional Individual Fairness NIPS 2023
Scalable Transformer for PDE Surrogate Modeling NIPS 2023
What is the Inductive Bias of Flatness Regularization? A Study of Deep Matrix Factorization Models NIPS 2023
Learning Layer-wise Equivariances Automatically using Gradients NIPS 2023
Networks are Slacking Off: Understanding Generalization Problem in Image Deraining NIPS 2023