conftrace_
← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3,648 papers

Papers per year

Papers

Gradient Flossing: Improving Gradient Descent through Dynamic Control of Jacobians NIPS 2023
Improving Adversarial Robustness via Information Bottleneck Distillation NIPS 2023
Hypernetwork-based Meta-Learning for Low-Rank Physics-Informed Neural Networks NIPS 2023
Are GATs Out of Balance? NIPS 2023
Bridging Discrete and Backpropagation: Straight-Through and Beyond NIPS 2023
Stabilized Neural Differential Equations for Learning Dynamics with Explicit Constraints NIPS 2023
On the Convergence and Sample Complexity Analysis of Deep Q-Networks with $\epsilon$-Greedy Exploration NIPS 2023
StEik: Stabilizing the Optimization of Neural Signed Distance Functions and Finer Shape Representation NIPS 2023
ResoNet: Noise-Trained Physics-Informed MRI Off-Resonance Correction NIPS 2023
On skip connections and normalisation layers in deep optimisation NIPS 2023
Softmax Output Approximation for Activation Memory-Efficient Training of Attention-based Networks NIPS 2023
Memory Efficient Optimizers with 4-bit States NIPS 2023
Convergence of mean-field Langevin dynamics: time-space discretization, stochastic gradient, and variance reduction NIPS 2023
To Stay or Not to Stay in the Pre-train Basin: Insights on Ensembling in Transfer Learning NIPS 2023
Neural (Tangent Kernel) Collapse NIPS 2023
Accelerated Training via Incrementally Growing Neural Networks using Variance Transfer and Learning Rate Adaptation NIPS 2023
Block Low-Rank Preconditioner with Shared Basis for Stochastic Optimization NIPS 2023
The Geometry of Neural Nets' Parameter Spaces Under Reparametrization NIPS 2023
MKOR: Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 Updates NIPS 2023
FlatMatch: Bridging Labeled Data and Unlabeled Data with Cross-Sharpness for Semi-Supervised Learning NIPS 2023
Evolutionary Neural Architecture Search for Transformer in Knowledge Tracing NIPS 2023
Learning threshold neurons via edge of stability NIPS 2023
Spectral Evolution and Invariance in Linear-width Neural Networks NIPS 2023
Exploiting Connections between Lipschitz Structures for Certifiably Robust Deep Equilibrium Models NIPS 2023
Nearly Optimal VC-Dimension and Pseudo-Dimension Bounds for Deep Neural Network Derivatives NIPS 2023