← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3648 directly classified papers

Papers per year

Papers

Enhancing Chain-of-Thought Reasoning with Critical Representation Fine-tuning ACL 2025
Exploring and Controlling Diversity in LLM-Agent Conversation EMNLP 2025
Exploring smaller batch sizes for a high-performing BabyLM model architecture EMNLP 2025
Good regularity creates large learning rate implicit biases: edge of stability, balancing, and catapult JMLR 2025
Tuning the Frequencies: Robust Training for Sinusoidal Neural Networks CVPR 2025
Transformers without Normalization CVPR 2025
Adaptive Gradient Learning for Spiking Neural Networks by Exploiting Membrane Potential Dynamics IJCAI 2025
Revisiting Gradient Normalization and Clipping for Nonconvex SGD under Heavy-Tailed Noise: Necessity, Sufficiency, and Acceleration JMLR 2025
LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steering ACL 2025
Continual Gradient Low-Rank Projection Fine-Tuning for LLMs ACL 2025
Efficiently Escaping Saddle Points in Bilevel Optimization JMLR 2025
Neural Operators Can Play Dynamic Stackelberg Games JMLR 2025
Reversal of Thought: Enhancing Large Language Models with Preference-Guided Reverse Reasoning Warm-up ACL 2025
MLAS-LoRA: Language-Aware Parameters Detection and LoRA-Based Knowledge Transfer for Multilingual Machine Translation ACL 2025
Equivariant Manifold Neural ODEs and Differential Invariants JMLR 2025
Training with Confidence: Catching Silent Errors in Deep Learning Training with Automated Proactive Checks OSDI 2025
Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking ACL 2025
Value Residual Learning ACL 2025
Critic-CoT: Boosting the Reasoning Abilities of Large Language Model via Chain-of-Thought Critic ACL 2025
Training Dynamics Underlying Language Model Scaling Laws: Loss Deceleration and Zero-Sum Learning ACL 2025
PowerMLP: An Efficient Version of KAN AAAI 2025
Instability, Computational Efficiency and Statistical Accuracy JMLR 2025
On Local Overfitting and Forgetting in Deep Neural Networks AAAI 2025
Sharpness-aware Zeroth-order Optimization for Graph Transformers IJCAI 2025
Balcony: A Lightweight Approach to Dynamic Inference of Generative Language Models EMNLP 2025