conftrace_
← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3,649 papers

Papers per year

2
5
40
414
386
'05
'10
'15
'20
'25

Papers

The Challenges of the Nonlinear Regime for Physics-Informed Neural Networks NIPS 2024
Accurate and Steady Inertial Pose Estimation through Sequence Structure Learning and Modulation NIPS 2024
Approximated Orthogonal Projection Unit: Stabilizing Regression Network Training Using Natural Gradient NIPS 2024
Slicing Vision Transformer for Flexible Inference NIPS 2024
DASH: Warm-Starting Neural Network Training in Stationary Settings without Loss of Plasticity NIPS 2024
Implicit Regularization of Sharpness-Aware Minimization for Scale-Invariant Problems NIPS 2024
Parameter-free Clipped Gradient Descent Meets Polyak NIPS 2024
DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion NIPS 2024
Training Dynamics of Transformers to Recognize Word Co-occurrence via Gradient Flow Analysis NIPS 2024
How does Gradient Descent Learn Features --- A Local Analysis for Regularized Two-Layer Neural Networks NIPS 2024
Controlling Continuous Relaxation for Combinatorial Optimization NIPS 2024
Stepping on the Edge: Curvature Aware Learning Rate Tuners NIPS 2024
Linear Transformers are Versatile In-Context Learners NIPS 2024
On Mesa-Optimization in Autoregressively Trained Transformers: Emergence and Capability NIPS 2024
Towards the Dynamics of a DNN Learning Symbolic Interactions NIPS 2024
SAMPa: Sharpness-aware Minimization Parallelized NIPS 2024
Vision Mamba Mender NIPS 2024
Improving Adaptivity via Over-Parameterization in Sequence Models NIPS 2024
LoRA-GA: Low-Rank Adaptation with Gradient Approximation NIPS 2024
Abrupt Learning in Transformers: A Case Study on Matrix Completion NIPS 2024
Algorithmic progress in language models NIPS 2024
Forgetting, Ignorance or Myopia: Revisiting Key Challenges in Online Continual Learning NIPS 2024
Where Do Large Learning Rates Lead Us? NIPS 2024
DFA-GNN: Forward Learning of Graph Neural Networks by Direct Feedback Alignment NIPS 2024
Unveiling The Matthew Effect Across Channels: Assessing Layer Width Sufficiency via Weight Norm Variance NIPS 2024