Optimization

Hierarchical Speculative Decoding with Dynamic Window NAACL 2025 HiRemate: Hierarchical Approach for Efficient Re-materialization of Neural Networks ICML 2025 How to Mitigate Overfitting in Weak-to-strong Generalization? ACL 2025 How to set AdamW’s weight decay as you scale model and dataset size ICML 2025 HUNet: Homotopy Unfolding Network for Image Compressive Sensing CVPR 2025 HVAdam: A Full-Dimension Adaptive Optimizer AAAI 2025 Identifying and Mitigating Position Bias of Multi-image Vision-Language Models CVPR 2025 Implicit Regularization for Tubal Tensor Factorizations via Gradient Descent ICML 2025 Improve Decoding Factuality by Token-wise Cross Layer Entropy of Large Language Models NAACL 2025 Improved Noise Schedule for Diffusion Training ICCV 2025 Improving Deep Learning Speed and Performance Through Synaptic Neural Balance AAAI 2025 Improving Generalization of Deep Neural Networks by Optimum Shifting AAAI 2025 Increasing Batch Size Improves Convergence of Stochastic Gradient Descent with Momentum ACML 2025 Instance-Wise Monotonic Calibration by Constrained Transformation UAI 2025 Integrating Independent Layer-Wise Rank Selection with Low-Rank SVD Training for Model Compression: A Theory-Driven Approach IJCAI 2025 JAQ: Joint Efficient Architecture Design and Low-Bit Quantization with Hardware-Software Co-Exploration AAAI 2025 Joint Gradient Balancing for Data Ordering in Finite-Sum Multi-Objective Optimization ICLR 2025 KeyGS: A Keyframe-Centric Gaussian Splatting Method for Monocular Image Sequences AAAI 2025 Label Set Optimization via Activation Distribution Kurtosis for Zero-Shot Classification with Generative Models EMNLP 2025 LAMB: A Training-Free Method to Enhance the Long-Context Understanding of SSMs via Attention-Guided Token Filtering ACL 2025 Large Vocabulary Size Improves Large Language Models ACL 2025 LAVa: Layer-wise KV Cache Eviction with Dynamic Budget Allocation EMNLP 2025 Learning a Single Index Model from Anisotropic Data with Vanilla Stochastic Gradient Descent AISTATS 2025 Learning Few-Step Diffusion Models by Trajectory Distribution Matching ICCV 2025 Learning from Streaming Video with Orthogonal Gradients CVPR 2025