Optimization & Theory
43,292 papers (3 classified directly here)
Subtopics · a paper can sit in several, so these overlap
Optimization (17,731)
Learning Theory (6,809)
Bayesian Inference (6,267)
Theory (5,579)
Statistical Learning (4,564)
Neural Network Optimization (4,155)
Stochastic Processes (2,948)
Stochastic Methods (1,283)
Loss Functions (1,220)
Distributed Learning (1,202)
Online Algorithms (1,013)
Statistics (822)
Generalization (376)
Information Theory (370)
Sample Complexity (282)
Sparse Optimization (241)
Game Theory (151)
Convex Optimization (132)
Optimal Transport (104)
Robust Optimization (84)
Distributed Optimization (73)
Approximation Algorithms (33)
Papers per year
1
14
29
44
31
52
189
195
212
235
352
382
457
787
816
828
1,066
1,391
1,913
3,012
3,646
4,303
4,450
5,357
6,155
5,854
1,521
2000
'5
'10
'15
'20
'25
Papers (including subtopics)
The Geometry of Prompting: Unveiling Distinct Mechanisms of Task Adaptation in Language Models
NAACL 2025
The Global Convergence Time of Stochastic Gradient Descent in Non-Convex Landscapes: Sharp Estimates via Large Deviations
ICML 2025
The Gradient of Algebraic Model Counting
AAAI 2025
The Hidden Attention of Mamba Models
ACL 2025
The Illusion of Randomness: How LLMs Fail to Emulate Stochastic Decision-Making in Rock-Paper-Scissors Games?
EMNLP 2025
The Impact Label Noise and Choice of Threshold has on Cross-Entropy and Soft-Dice in Image Segmentation
CVPR 2025
The impact of allocation strategies in subset learning on the expressive power of neural networks
ICLR 2025
The Impact of On-Policy Parallelized Data Collection on Deep Reinforcement Learning Networks
ICML 2025
The Importance of Being Lazy: Scaling Limits of Continual Learning
ICML 2025
The Inter-Intra Modal Measure: A Predictive Lens on Fine-Tuning Outcomes in Vision-Language Models
ICCV 2025
The interventional Bayesian Gaussian equivalent score for Bayesian causal inference with unknown soft interventions
CLeaR 2025
The Inverse Scaling Effect of Pre-Trained Language Model Surprisal Is Not Due to Data Leakage
ACL 2025
The Journey Matters: Average Parameter Count over Pre-training Unifies Sparse and Dense Scaling Laws
ICLR 2025
The KoLMogorov Test: Compression by Code Generation
ICLR 2025
The late-stage training dynamics of (stochastic) subgradient descent on homogeneous neural networks
COLT 2025
The Law of Knowledge Overshadowing: Towards Understanding, Predicting, and Preventing LLM Hallucination
ACL 2025
The Lessons of Developing Process Reward Models in Mathematical Reasoning
ACL 2025
The Linguistic Connectivities Within Large Language Models
ACL 2025
The LLM Already Knows: Estimating LLM-Perceived Question Difficulty via Hidden Representations
EMNLP 2025
The Local Learning Coefficient: A Singularity-Aware Complexity Measure
AISTATS 2025
The ODE Method for Stochastic Approximation and Reinforcement Learning with Markovian Noise
JMLR 2025
The Optimization Landscape of SGD Across the Feature Learning Strength
ICLR 2025
Theoretical Analysis of Evolutionary Algorithms with Quality Diversity for a Classical Path Planning Problem
IJCAI 2025
Theoretical Analysis of Hierarchical Language Recognition and Generation by Transformers without Positional Encoding
ACL 2025
Theoretical Analysis of Leave-one-out Cross Validation for Non-differentiable Penalties under High-dimensional Settings
AISTATS 2025