← Optimization & Theory
Deep Learning › Optimization & Theory ›

Optimization

1638 directly classified papers

Papers per year

Papers

Towards understanding how momentum improves generalization in deep learning ICML 2022
Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularization ICML 2022
Secure Distributed Training at Scale ICML 2022
How to Fill the Optimum Set? Population Gradient Descent with Harmless Diversity ICML 2022
Faster Privacy Accounting via Evolving Discretization ICML 2022
Fast and Reliable Evaluation of Adversarial Robustness with Minimum-Margin Attack ICML 2022
Optimal Clipping and Magnitude-aware Differentiation for Improved Quantization-aware Training ICML 2022
Deep Network Approximation in Terms of Intrinsic Parameters ICML 2022
Lightweight Projective Derivative Codes for Compressed Asynchronous Gradient Descent ICML 2022
EF-BV: A Unified Theory of Error Feedback and Variance Reduction Mechanisms for Biased and Unbiased Compression in Distributed Optimization NIPS 2022
Large-batch Optimization for Dense Visual Predictions: Training Faster R-CNN in 4.2 Minutes NIPS 2022
Optimal Transport-based Identity Matching for Identity-invariant Facial Expression Recognition NIPS 2022
3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation ICML 2022
A Simple Guard for Learned Optimizers ICML 2022
Adaptive Second Order Coresets for Data-efficient Machine Learning ICML 2022
A Differential Entropy Estimator for Training Neural Networks ICML 2022
AutoSNN: Towards Energy-Efficient Spiking Neural Networks ICML 2022
Fast Convex Optimization for Two-Layer ReLU Networks: Equivalent Model Classes and Cone Decompositions ICML 2022
Design-Bench: Benchmarks for Data-Driven Offline Model-Based Optimization ICML 2022
Nesterov Accelerated Shuffling Gradient Method for Convex Optimization ICML 2022
Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-Lojasiewicz Functions when the Non-Convexity is Averaged-Out ICML 2022
When Do Flat Minima Optimizers Work? NIPS 2022
Projective Manifold Gradient Layer for Deep Rotation Regression CVPR 2022
Arch-Graph: Acyclic Architecture Relation Predictor for Task-Transferable Neural Architecture Search CVPR 2022
Towards Efficient and Scalable Sharpness-Aware Minimization CVPR 2022