Optimization

The Geometry of Robust Value Functions ICML 2022 The Hessian Screening Rule NeurIPS 2022 The Hidden Convex Optimization Landscape of Regularized Two-Layer ReLU Networks: an Exact Characterization of Optimal Solutions ICLR 2022 The Implicit Values of a Good Hand Shake: Handheld Multi-Frame Neural Depth Refinement CVPR 2022 The Importance of Hyperparameter Optimisation for Facial Recognition Applications AAAI 2022 The least-control principle for local learning at equilibrium NeurIPS 2022 The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models EMNLP 2022 Theoretical Convergence of Multi-Step Model-Agnostic Meta-Learning JMLR 2022 Theoretically Better and Numerically Faster Distributed Optimization with Smoothness-Aware Quantization Techniques NeurIPS 2022 "The Pedestrian Next to the Lamppost" Adaptive Object Graphs for Better Instantaneous Mapping CVPR 2022 The Perils of Learning Before Optimizing AAAI 2022 The Power of Adaptivity in SGD: Self-Tuning Step Sizes with Unbounded Gradients and Affine Variance COLT 2022 The power of first-order smooth optimization for black-box non-smooth problems ICML 2022 The Probabilistic Normal Epipolar Constraint for Frame-to-Frame Rotation Optimization Under Uncertain Feature Positions CVPR 2022 The Query Complexity of Local Search and Brouwer in Rounds COLT 2022 The Role of Baselines in Policy Gradient Optimization NeurIPS 2022 The role of optimization geometry in single neuron learning AISTATS 2022 Theseus: A Library for Differentiable Nonlinear Optimization NeurIPS 2022 The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models NeurIPS 2022 The Structured Abstain Problem and the Lovász Hinge COLT 2022 The Untapped Potential of Off-the-Shelf Convolutional Neural Networks WACV 2022 Thompson Sampling for (Combinatorial) Pure Exploration ICML 2022 Three-stage Evolution and Fast Equilibrium for SGD with Non-degerate Critical Points ICML 2022 Tight Analysis of Extra-gradient and Optimistic Gradient Methods For Nonconvex Minimax Problems NeurIPS 2022 Tight Neural Network Verification via Semidefinite Relaxations and Linear Reformulations AAAI 2022