Optimization & Theory
43,292 papers (3 classified directly here)
Subtopics · a paper can sit in several, so these overlap
Optimization (17,731)
Learning Theory (6,809)
Bayesian Inference (6,267)
Theory (5,579)
Statistical Learning (4,564)
Neural Network Optimization (4,155)
Stochastic Processes (2,948)
Stochastic Methods (1,283)
Loss Functions (1,220)
Distributed Learning (1,202)
Online Algorithms (1,013)
Statistics (822)
Generalization (376)
Information Theory (370)
Sample Complexity (282)
Sparse Optimization (241)
Game Theory (151)
Convex Optimization (132)
Optimal Transport (104)
Robust Optimization (84)
Distributed Optimization (73)
Approximation Algorithms (33)
Papers per year
1
14
29
44
31
52
189
195
212
235
352
382
457
787
816
828
1,066
1,391
1,913
3,012
3,646
4,303
4,450
5,357
6,155
5,854
1,521
2000
'5
'10
'15
'20
'25
Papers (including subtopics)
How Speculative Can Speculative Decoding Be?
COLING 2024
How Spurious Features are Memorized: Precise Analysis for Random and NTK Features
ICML 2024
How to Boost Any Loss Function
NeurIPS 2024
How to Escape Sharp Minima with Random Perturbations
ICML 2024
How to Evaluate Behavioral Models
AAAI 2024
How to Explore with Belief: State Entropy Maximization in POMDPs
ICML 2024
How to Fine-Tune Vision Models with SGD
ICLR 2024
How to Make the Gradients Small Privately: Improved Rates for Differentially Private Non-Convex Optimization
ICML 2024
How to Protect Copyright Data in Optimization of Large Language Models?
AAAI 2024
How to Solve Contextual Goal-Oriented Problems with Offline Datasets?
NeurIPS 2024
How to Train the Teacher Model for Effective Knowledge Distillation
ECCV 2024
How to Use the Metropolis Algorithm for Multi-Objective Optimization?
AAAI 2024
How Transformers Learn Causal Structure with Gradient Descent
ICML 2024
How Transformers Utilize Multi-Head Attention in In-Context Learning? A Case Study on Sparse Linear Regression
NeurIPS 2024
How Two-Layer Neural Networks Learn, One (Giant) Step at a Time
JMLR 2024
How Uniform Random Weights Induce Non-uniform Bias: Typical Interpolating Neural Networks Generalize with Narrow Teachers
ICML 2024
How Well Can a Genetic Algorithm Fine-tune Transformer Encoders? A First Approach
NAACL 2024
HPipe: Large Language Model Pipeline Parallelism for Long Context on Heterogeneous Cost-effective Devices
NAACL 2024
HPOD: Hyperparameter Optimization for Unsupervised Outlier Detection
AutoML 2024
HPO-RL-Bench: A Zero-Cost Benchmark for HPO in Reinforcement Learning
AutoML 2024
HSVI-based online minimax strategies for partially observable stochastic games with neural perception mechanisms
L4DC 2024
HTCCN: Temporal Causal Convolutional Networks with Hawkes Process for Extrapolation Reasoning in Temporal Knowledge Graphs
NAACL 2024
HuBERT-EE: Early Exiting HuBERT for Efficient Speech Recognition
Interspeech 2024
Human Alignment of Large Language Models through Online Preference Optimisation
ICML 2024
Human-LLM Hybrid Text Answer Aggregation for Crowd Annotations
EMNLP 2024