← Optimization & Theory
Deep Learning › Optimization & Theory ›

Optimization

1638 directly classified papers

Papers per year

Papers

Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum ICML 2022
Detached Error Feedback for Distributed SGD with Random Sparsification ICML 2022
Optimally Controllable Perceptual Lossy Compression ICML 2022
Revisiting and Advancing Fast Adversarial Training Through The Lens of Bi-Level Optimization ICML 2022
NysADMM: faster composite convex optimization via low-rank approximation ICML 2022
Dimension-free Complexity Bounds for High-order Nonconvex Finite-sum Optimization ICML 2022
On Numerical Integration in Neural Ordinary Differential Equations ICML 2022
Inductive Matrix Completion: No Bad Local Minima and a Fast Algorithm ICML 2022
To Fold or Not to Fold: a Necessary and Sufficient Condition on Batch-Normalization Layers Folding IJCAI 2022
Taylor-Lagrange Neural Ordinary Differential Equations: Toward Fast Training and Evaluation of Neural ODEs IJCAI 2022
Improving Neural Ordinary Differential Equations with Nesterov's Accelerated Gradient Method NIPS 2022
On the SDEs and Scaling Rules for Adaptive Gradient Algorithms NIPS 2022
A Fast Scale-Invariant Algorithm for Non-negative Least Squares with Non-negative Data NIPS 2022
Differentiable Analog Quantum Computing for Optimization and Control NIPS 2022
Convergence Rates of Non-Convex Stochastic Gradient Descent Under a Generic Lojasiewicz Condition and Local Smoothness ICML 2022
Tencent’s Multilingual Machine Translation System for WMT22 Large-Scale African Languages EMNLP 2022
MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences EMNLP 2022
The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models EMNLP 2022
GA-SAM: Gradient-Strength based Adaptive Sharpness-Aware Minimization for Improved Generalization EMNLP 2022
Spline-PINN: Approaching PDEs without Data Using Fast, Physics-Informed Hermite-Spline CNNs AAAI 2022
On the Impact of Spurious Correlation for Out-of-Distribution Detection AAAI 2022
Increasing the Diversity of Deep Generative Models AAAI 2022
Sketching as a Tool for Understanding and Accelerating Self-attention for Long Sequences NAACL 2022
Quality-Aware Decoding for Neural Machine Translation NAACL 2022
Perception Prioritized Training of Diffusion Models CVPR 2022