Optimization

HoD-Net: High-Order Differentiable Deep Neural Networks and Applications AAAI 2022 How to Fill the Optimum Set? Population Gradient Descent with Harmless Diversity ICML 2022 Image Based Reconstruction of Liquids From 2D Surface Detections CVPR 2022 Improved techniques for deterministic l2 robustness NeurIPS 2022 Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging EMNLP 2022 Improving Neural Ordinary Differential Equations with Nesterov's Accelerated Gradient Method NeurIPS 2022 Increasing the Diversity of Deep Generative Models AAAI 2022 Inductive Matrix Completion: No Bad Local Minima and a Fast Algorithm ICML 2022 Kantorovich Strikes Back! Wasserstein GANs are not Optimal Transport? NeurIPS 2022 KOALA: A Kalman Optimization Algorithm with Loss Adaptivity AAAI 2022 Large-batch Optimization for Dense Visual Predictions: Training Faster R-CNN in 4.2 Minutes NeurIPS 2022 Large Learning Rate Tames Homogeneity: Convergence and Balancing Effect ICLR 2022 Learning Deep Input-Output Stable Dynamics NeurIPS 2022 Lightweight Projective Derivative Codes for Compressed Asynchronous Gradient Descent ICML 2022 Looking Beyond GPUs for DNN Scheduling on Multi-Tenant Clusters OSDI 2022 Ludus: An Optimization Framework to Balance Auto Battler Cards AAAI 2022 Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach NeurIPS 2022 Massive-scale Decoding for Text Generation using Lattices NAACL 2022 Minibatch vs Local SGD with Shuffling: Tight Convergence Bounds and Beyond ICLR 2022 MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences EMNLP 2022 Module-Aware Optimization for Auxiliary Learning NeurIPS 2022 Monotonic Differentiable Sorting Networks ICLR 2022 MSR-NV: Neural Vocoder Using Multiple Sampling Rates Interspeech 2022 Multi-Path Transformer is Better: A Case Study on Neural Machine Translation EMNLP 2022 Nesterov Accelerated Shuffling Gradient Method for Convex Optimization ICML 2022