← Optimization & Theory
Deep Learning › Optimization & Theory ›

Optimization

1638 directly classified papers

Papers per year

Papers

Implicit Regularization of Sharpness-Aware Minimization for Scale-Invariant Problems NIPS 2024
PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Accelerator NIPS 2024
Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration NIPS 2024
Tighter Convergence Bounds for Shuffled SGD via Primal-Dual Perspective NIPS 2024
Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion NIPS 2024
Scalable Optimization in the Modular Norm NIPS 2024
Transferability Bound Theory: Exploring Relationship between Adversarial Transferability and Flatness NIPS 2024
Decoupled Kullback-Leibler Divergence Loss NIPS 2024
BiDM: Pushing the Limit of Quantization for Diffusion Models NIPS 2024
2DQuant: Low-bit Post-Training Quantization for Image Super-Resolution NIPS 2024
ORPO: Monolithic Preference Optimization without Reference Model EMNLP 2024
Soft ascent-descent as a stable and flexible alternative to flooding NIPS 2024
Parameter Efficient Fine-tuning via Cross Block Orchestration for Segment Anything Model CVPR 2024
Space-Time Continuous PDE Forecasting using Equivariant Neural Fields NIPS 2024
Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers NIPS 2024
ZO-AdaMU Optimizer: Adapting Perturbation by the Momentum and Uncertainty in Zeroth-Order Optimization AAAI 2024
Self-Calibrating Vicinal Risk Minimisation for Model Calibration CVPR 2024
Gradient Descent Finds the Global Optima of Two-Layer Physics-Informed Neural Networks ICML 2023
Convergence of Proximal Point and Extragradient-Based Methods Beyond Monotonicity: the Case of Negative Comonotonicity ICML 2023
Principled Acceleration of Iterative Numerical Methods Using Machine Learning ICML 2023
Understanding Incremental Learning of Gradient Descent: A Fine-grained Analysis of Matrix Sensing ICML 2023
Moccasin: Efficient Tensor Rematerialization for Neural Networks ICML 2023
Minimizing Trajectory Curvature of ODE-based Generative Models ICML 2023
Implicit Jacobian regularization weighted with impurity of probability output ICML 2023
Optimal Convergence Rates for Agnostic Nyström Kernel Learning ICML 2023