Optimization

MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts NeurIPS 2024 MOSEL: Inference Serving Using Dynamic Modality Selection EMNLP 2024 Multi-scale Consistency for Robust 3D Registration via Hierarchical Sinkhorn Tree NeurIPS 2024 Nature-Inspired Local Propagation NeurIPS 2024 Near-Optimal Distributed Minimax Optimization under the Second-Order Similarity NeurIPS 2024 Neur2BiLO: Neural Bilevel Optimization NeurIPS 2024 Neural Flow Diffusion Models: Learnable Forward Process for Improved Diffusion Modelling NeurIPS 2024 Neural Optimal Transport with Lagrangian Costs UAI 2024 Newton Losses: Using Curvature Information for Learning with Differentiable Algorithms NeurIPS 2024 Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers NeurIPS 2024 No Wrong Turns: The Simple Geometry Of Neural Networks Optimization Paths ICML 2024 Once for Both: Single Stage of Importance and Sparsity Search for Vision Transformer Compression CVPR 2024 On Convergence of Incremental Gradient for Non-convex Smooth Functions ICML 2024 One-step Diffusion with Distribution Matching Distillation CVPR 2024 One-Step Forward and Backtrack: Overcoming Zig-Zagging in Loss-Aware Quantization Training AAAI 2024 Online Conversion Rate Prediction via Multi-Interval Screening and Synthesizing under Delayed Feedback AAAI 2024 On the Asymptotic Distribution of the Minimum Empirical Risk ICML 2024 On the Comparison between Multi-modal and Single-modal Contrastive Learning NeurIPS 2024 On the Duality Between Sharpness-Aware Minimization and Adversarial Training ICML 2024 On the Hyperparameters in Stochastic Gradient Descent with Momentum JMLR 2024 On the Impact of Overparameterization on the Training of a Shallow Neural Network in High Dimensions AISTATS 2024 On the Unstable Convergence Regime of Gradient Descent AAAI 2024 Open Problem: Anytime Convergence Rate of Gradient Descent COLT 2024 Open Problem: Black-Box Reductions and Adaptive Gradient Methods for Nonconvex Optimization COLT 2024 OptEx: Expediting First-Order Optimization with Approximately Parallelized Iterations NeurIPS 2024