conftrace_

Optimization & Theory

7,804 papers (27 classified directly here)

Subtopics · a paper can sit in several, so these overlap

Optimization (1,960) Model Compression (1,896) Efficient Computing (1,780) Theory (1,239) Neural Network Optimization (1,004) Evaluation (533) Regularization (177) Loss Functions (157) Interpretability (128) Stochastic Methods (119) Generalization (115) Sparse Optimization (25)

Papers per year

8

7

12

6

16

9

25

48

45

60

94

150

295

436

675

803

1,010

944

1,346

1,352

463

'10

'15

'20

'25

Papers (including subtopics)

Towards Disentangling Information Paths with Coded ResNeXt NeurIPS 2022 Towards Efficient 3D Object Detection with Knowledge Distillation NeurIPS 2022 Towards Efficient and Scalable Sharpness-Aware Minimization CVPR 2022 Towards Efficient NLP: A Standard Evaluation and A Strong Baseline NAACL 2022 Towards Fully Sparse Training: Information Restoration with Spatial Similarity AAAI 2022 Towards Light-Weight and Real-Time Line Segment Detection AAAI 2022 Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent ICML 2022 Towards One Shot Search Space Poisoning in Neural Architecture Search (Student Abstract) AAAI 2022 Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration JMLR 2022 Towards Practical Certifiable Patch Defense With Vision Transformer CVPR 2022 Towards Practical Control of Singular Values of Convolutional Layers NeurIPS 2022 Towards Robust k-Nearest-Neighbor Machine Translation EMNLP 2022 Towards Robust Numerical Question Answering: Diagnosing Numerical Capabilities of NLP Systems EMNLP 2022 Towards Theoretical Analysis of Transformation Complexity of ReLU DNNs ICML 2022 Towards Theoretically Inspired Neural Initialization Optimization NeurIPS 2022 Towards Training Billion Parameter Graph Neural Networks for Atomic Simulations ICLR 2022 Towards Understanding Grokking: An Effective Theory of Representation Learning NeurIPS 2022 Towards understanding how momentum improves generalization in deep learning ICML 2022 Towards Understanding the Mixture-of-Experts Layer in Deep Learning NeurIPS 2022 Tracing and Manipulating intermediate values in Neural Math Problem Solvers EMNLP 2022 Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes NeurIPS 2022 Training Two-Layer ReLU Networks with Gradient Descent is Inconsistent JMLR 2022 Training Up to 50 Class ML Models on 3 $ IoT Hardware via Optimizing One-vs-One Algorithm (Student Abstract) AAAI 2022 Training Your Sparse Neural Network Better with Any Mask ICML 2022 Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions NeurIPS 2022