conftrace_
← Deep Learning
Deep Learning ›

Optimization & Theory

6,829 papers (27 classified directly here)

Subtopics

Model Compression (1,785) Optimization (1,664) Efficient Computing (1,579) Theory (1,082) Neural Network Optimization (903) Evaluation (509) Loss Functions (123) Interpretability (105) Stochastic Methods (97) Regularization (77) Generalization (24) Sparse Optimization (7)

Papers per year

8
50
642
1173
'10
'15
'20
'25

Papers (including subtopics)

UPSCALE: Unconstrained Channel Pruning ICML 2023
DIVISION: Memory Efficient Training via Dual Activation Precision ICML 2023
CocktailSGD: Fine-tuning Foundation Models over 500Mbps Networks ICML 2023
Polarity Is All You Need to Learn and Transfer Faster ICML 2023
Robustly Learning a Single Neuron via Sharpness ICML 2023
Global optimality for Euclidean CCCP under Riemannian convexity ICML 2023
Optimizing Mode Connectivity for Class Incremental Learning ICML 2023
Two Losses Are Better Than One: Faster Optimization Using a Cheaper Proxy ICML 2023
Anchor Sampling for Federated Learning with Partial Client Participation ICML 2023
A Law of Robustness beyond Isoperimetry ICML 2023
Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases ICML 2023
The Implicit Regularization of Dynamical Stability in Stochastic Gradient Descent ICML 2023
On the Training Instability of Shuffling SGD with Batch Normalization ICML 2023
Finite-Sample Analysis of Learning High-Dimensional Single ReLU Neuron ICML 2023
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models ICML 2023
COMCAT: Towards Efficient Compression and Customization of Attention-Based Vision Models ICML 2023
Improving Bi-level Optimization Based Methods with Inspiration from Humans’ Classroom Study Techniques ICML 2023
Bit Allocation using Optimization ICML 2023
SLAMB: Accelerated Large Batch Training with Sparse Communication ICML 2023
Do Not Train It: A Linear Neural Architecture Search of Graph Neural Networks ICML 2023
LazyGNN: Large-Scale Graph Neural Networks via Lazy Propagation ICML 2023
Adaptive Computation with Elastic Input Sequence ICML 2023
Quantum Ridgelet Transform: Winning Lottery Ticket of Neural Networks with Quantum Computation ICML 2023
Towards Sustainable Learning: Coresets for Data-efficient Deep Learning ICML 2023
Analyzing Convergence in Quantum Neural Networks: Deviations from Neural Tangent Kernels ICML 2023