Neural Network Optimization

ENAF: A Multi-Exit Network with an Adaptive Patch Fusion for Large Image Super Resolution WACV 2025 Enhancing Chain-of-Thought Reasoning via Neuron Activation Differential Analysis EMNLP 2025 Error Analysis Affected by Heavy-Tailed Gradients for Non-Convex Pairwise Stochastic Gradient Descent AAAI 2025 Explicit and Implicit Graduated Optimization in Deep Neural Networks AAAI 2025 Exploring smaller batch sizes for a high-performing BabyLM model architecture EMNLP 2025 FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusion CVPR 2025 Fast and Slow Gradient Approximation for Binary Neural Network Optimization AAAI 2025 Feature Spectrum Learning for Remote Sensing Change Detection CVPR 2025 Flexora: Flexible Low-Rank Adaptation for Large Language Models ACL 2025 FREE: Fast and Robust Vision Language Models with Early Exits ACL 2025 Fuzzy Speculative Decoding for a Tunable Accuracy-Runtime Tradeoff ACL 2025 Get rid of your constraints and reparametrize: A study in NNLS and implicit bias AISTATS 2025 GliaNet: Adaptive Neural Network Structure Learning with Glia-Driven CVPR 2025 Gradient descent with generalized Newton’s method ICLR 2025 GRASP: Replace Redundant Layers with Adaptive Singular Parameters for Efficient Model Compression EMNLP 2025 HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization EMNLP 2025 ICP: Immediate Compensation Pruning for Mid-to-high Sparsity CVPR 2025 IG-Pruning: Input-Guided Block Pruning for Large Language Models EMNLP 2025 Improving Generalization of Deep Neural Networks by Optimum Shifting AAAI 2025 Increasing Batch Size Improves Convergence of Stochastic Gradient Descent with Momentum ACML 2025 Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking ACL 2025 Language Models Grow Less Humanlike beyond Phase Transition ACL 2025 Large Learning Rates Simultaneously Achieve Robustness to Spurious Correlations and Compressibility ICCV 2025 Last-iterate Convergence of Shuffling Momentum Gradient Method under the Kurdyka-Lojasiewicz Inequality JMLR 2025 Learning from Streaming Video with Orthogonal Gradients CVPR 2025