conftrace_
← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3,649 papers

Papers per year

2
5
40
414
386
'05
'10
'15
'20
'25

Papers

Scan and Snap: Understanding Training Dynamics and Token Composition in 1-layer Transformer NIPS 2023
Learning Adaptive Tensorial Density Fields for Clean Cryo-ET Reconstruction NIPS 2023
Resetting the Optimizer in Deep RL: An Empirical Study NIPS 2023
Why Does Sharpness-Aware Minimization Generalize Better Than SGD? NIPS 2023
How to Scale Your EMA NIPS 2023
Implicit Bias of Gradient Descent for Logistic Regression at the Edge of Stability NIPS 2023
Two Sides of One Coin: the Limits of Untuned SGD and the Power of Adaptive Methods NIPS 2023
Adversarial Training from Mean Field Perspective NIPS 2023
On the Convergence to a Global Solution of Shuffling-Type Gradient Algorithms NIPS 2023
Sketchy: Memory-efficient Adaptive Regularization with Frequent Directions NIPS 2023
Momentum Provably Improves Error Feedback! NIPS 2023
Alternating Updates for Efficient Transformers NIPS 2023
Turbulence in Focus: Benchmarking Scaling Behavior of 3D Volumetric Super-Resolution with BLASTNet 2.0 Data NIPS 2023
Improving Robustness with Adaptive Weight Decay NIPS 2023
Towards Data-Agnostic Pruning At Initialization: What Makes a Good Sparse Mask? NIPS 2023
Mitigating Over-smoothing in Transformers via Regularized Nonlocal Functionals NIPS 2023
AutoRL Hyperparameter Landscapes AUTOML 2023
“No Free Lunch” in Neural Architectures? A Joint Analysis of Expressivity, Convergence, and Generalization AUTOML 2023
AlphaD3M: An Open-Source AutoML Library for Multiple ML Tasks AUTOML 2023
DATT: Deep Adaptive Trajectory Tracking for Quadrotor Control CORL 2023
Complex Dynamic Neurons Improved Spiking Transformer Network for Efficient Automatic Speech Recognition AAAI 2023
Learning Fractals by Gradient Descent AAAI 2023
Low-Light Image Enhancement Network Based on Multi-Scale Feature Complementation AAAI 2023
SCI: A Spectrum Concentrated Implicit Neural Compression for Biomedical Data AAAI 2023
A Noise-Tolerant Differentiable Learning Approach for Single Occurrence Regular Expression with Interleaving AAAI 2023