Optimization & Theory
43,292 papers (3 classified directly here)
Subtopics · a paper can sit in several, so these overlap
Optimization (17,731)
Learning Theory (6,809)
Bayesian Inference (6,267)
Theory (5,579)
Statistical Learning (4,564)
Neural Network Optimization (4,155)
Stochastic Processes (2,948)
Stochastic Methods (1,283)
Loss Functions (1,220)
Distributed Learning (1,202)
Online Algorithms (1,013)
Statistics (822)
Generalization (376)
Information Theory (370)
Sample Complexity (282)
Sparse Optimization (241)
Game Theory (151)
Convex Optimization (132)
Optimal Transport (104)
Robust Optimization (84)
Distributed Optimization (73)
Approximation Algorithms (33)
Papers per year
1
14
29
44
31
52
189
195
212
235
352
382
457
787
816
828
1,066
1,391
1,913
3,012
3,646
4,303
4,450
5,357
6,155
5,854
1,521
2000
'5
'10
'15
'20
'25
Papers (including subtopics)
On the expressiveness and spectral bias of KANs
ICLR 2025
On the Expressiveness of Rational ReLU Neural Networks With Bounded Depth
ICLR 2025
On the Feature Learning in Diffusion Models
ICLR 2025
On the Generalization of Feature Incremental Learning
IJCAI 2025
On the Generalization vs Fidelity Paradox in Knowledge Distillation
ACL 2025
On the Hardness of Bandit Learning
COLT 2025
On the Hardness of Learning One Hidden Layer Neural Networks
ALT 2025
On the Hardness of Training Deep Neural Networks Discretely
AAAI 2025
On the Importance of Embedding Norms in Self-Supervised Learning
ICML 2025
On the Inherent Privacy of Zeroth-Order Projected Gradient Descent
AISTATS 2025
On the Interplay between Graph Structure and Learning Algorithms in Graph Neural Networks
ICML 2025
On the Interplay between Positional Encodings, Morphological Complexity, and Word Order Flexibility
IJCNLP 2025
On the Learnability of Distribution Classes with Adaptive Adversaries
ICML 2025
On the Learn-to-Optimize Capabilities of Transformers in In-Context Sparse Recovery
ICLR 2025
On the Local Complexity of Linear Regions in Deep ReLU Networks
ICML 2025
On the Logic of Theory Base Change: Reformulation of Belief Bases
AAAI 2025
On the Minimax Regret of Sequential Probability Assignment via Square-Root Entropy
COLT 2025
On the Modelling of Constraints with Tractable Logical Operators
AAAI 2025
On the Natural Gradient of the Evidence Lower Bound
JMLR 2025
On the Optimal Memorization Capacity of Transformers
ICLR 2025
On the Optimization Landscape of Low Rank Adaptation Methods for Large Language Models
ICLR 2025
On the O(sqrt(d)/T^(1/4)) Convergence Rate of RMSProp and Its Momentum Extension Measured by l_1 Norm
JMLR 2025
On the Out-of-Distribution Generalization of Self-Supervised Learning
ICML 2025
On the Performance Analysis of Momentum Method: A Frequency Domain Perspective
ICLR 2025
On the Power of Multitask Representation Learning with Gradient Descent
AISTATS 2025