Optimization & Theory
43,292 papers (3 classified directly here)
Subtopics · a paper can sit in several, so these overlap
Optimization (17,731)
Learning Theory (6,809)
Bayesian Inference (6,267)
Theory (5,579)
Statistical Learning (4,564)
Neural Network Optimization (4,155)
Stochastic Processes (2,948)
Stochastic Methods (1,283)
Loss Functions (1,220)
Distributed Learning (1,202)
Online Algorithms (1,013)
Statistics (822)
Generalization (376)
Information Theory (370)
Sample Complexity (282)
Sparse Optimization (241)
Game Theory (151)
Convex Optimization (132)
Optimal Transport (104)
Robust Optimization (84)
Distributed Optimization (73)
Approximation Algorithms (33)
Papers per year
1
14
29
44
31
52
189
195
212
235
352
382
457
787
816
828
1,066
1,391
1,913
3,012
3,646
4,303
4,450
5,357
6,155
5,854
1,521
2000
'5
'10
'15
'20
'25
Papers (including subtopics)
From Individual Experience to Collective Evidence: A Reporting-Based Framework for Identifying Systemic Harms
ICML 2025
From Individual to Universal: Regularized Multi-view Joint Representation for Multi-view Subspace-Preserving Recovery
IJCAI 2025
From Input Perception to Predictive Insight: Modeling Model Blind Spots Before They Become Errors
EMNLP 2025
From Kernels to Features: A Multi-Scale Adaptive Theory of Feature Learning
ICML 2025
From Laboratory to Real World: A New Benchmark Towards Privacy-Preserved Visible-Infrared Person Re-Identification
CVPR 2025
From Layers to States: A State Space Model Perspective to Deep Neural Network Layer Dynamics
ICLR 2025
From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks
ICLR 2025
From Learning to Optimize to Learning Optimization Algorithms
AISTATS 2025
From Logistic Regression to the Perceptron Algorithm: Exploring Gradient Descent with Large Step Sizes
AAAI 2025
From n-gram to Attention: How Model Architectures Learn and Propagate Bias in Language Modeling
EMNLP 2025
From Parameters to Performance: A Data-Driven Study on LLM Structure and Development
EMNLP 2025
From PEFT to DEFT: Parameter Efficient Finetuning for Reducing Activation Density in Transformers
AAAI 2025
From Perceptions to Decisions: Wildfire Evacuation Decision Prediction with Behavioral Theory-informed LLMs
ACL 2025
From Problem-Solving to Teaching Problem-Solving: Aligning LLMs with Pedagogy using Reinforcement Learning
EMNLP 2025
From Promise to Practice: Realizing High-performance Decentralized Training
ICLR 2025
From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuning
ICCV 2025
From Remembering to Metacognition: Do Existing Benchmarks Accurately Evaluate LLMs?
EMNLP 2025
From Risk to Uncertainty: Generating Predictive Uncertainty Measures via Bayesian Estimation
ICLR 2025
From Sparse Dependence to Sparse Attention: Unveiling How Chain-of-Thought Enhances Transformer Sample Efficiency
ICLR 2025
From Sparse to Dense Functional Data in High Dimensions: Revisiting Phase Transitions from a Non-Asymptotic Perspective
JMLR 2025
From Stories to Statistics: Methodological Biases in LLM-Based Narrative Flow Quantification
CoNLL 2025
From Teacher to Student: Tracking Memorization Through Model Distillation
ACL 2025
From Theory to Practice: Rethinking Green and Martin Kernels for Unleashing Graph Transformers
ICML 2025
From Tokens to Lattices: Emergent Lattice Structures in Language Models
ICLR 2025
From Token to Action: State Machine Reasoning to Mitigate Overthinking in Information Retrieval
EMNLP 2025