← Optimization & Theory
Deep Learning › Optimization & Theory ›

Neural Network Optimization

902 directly classified papers

Papers per year

Papers

Polynomial Implicit Neural Representations for Large Diverse Datasets CVPR 2023
CAME: Confidence-guided Adaptive Memory Efficient Optimization ACL 2023
Can Forward Gradient Match Backpropagation? ICML 2023
Symbolic Discovery of Optimization Algorithms NIPS 2023
Understanding Representation Learnability of Nonlinear Self-Supervised Learning AAAI 2023
Understanding Imbalanced Semantic Segmentation Through Neural Collapse CVPR 2023
AGD: an Auto-switchable Optimizer using Stepwise Gradient Difference for Preconditioning Matrix NIPS 2023
Token-Level Self-Evolution Training for Sequence-to-Sequence Learning ACL 2023
Bias in Pruned Vision Models: In-Depth Analysis and Countermeasures CVPR 2023
Achieving High Accuracy with PINNs via Energy Natural Gradient Descent ICML 2023
Initialization Noise in Image Gradients and Saliency Maps CVPR 2023
Neural Architecture Search for Parameter-Efficient Fine-tuning of Large Pre-trained Language Models ACL 2023
EfficientViT: Memory Efficient Vision Transformer With Cascaded Group Attention CVPR 2023
Differentiable Architecture Search With Random Features CVPR 2023
TIPI: Test Time Adaptation With Transformation Invariance CVPR 2023
Global Vision Transformer Pruning With Hessian-Aware Saliency CVPR 2023
SparseProp: Efficient Sparse Backpropagation for Faster Training of Neural Networks at the Edge ICML 2023
Co-Training 2L Submodels for Visual Recognition CVPR 2023
Partition Speeds Up Learning Implicit Neural Representations Based on Exponential-Increase Hypothesis ICCV 2023
TRAMS: Training-free Memory Selection for Long-range Language Modeling EMNLP 2023
Bi-Drop: Enhancing Fine-tuning Generalization via Synchronous sub-net Estimation and Optimization EMNLP 2023
Zero-Cost Operation Scoring in Differentiable Architecture Search AAAI 2023
Algorithmic Stability of Heavy-Tailed SGD with General Loss Functions ICML 2023
LazyGNN: Large-Scale Graph Neural Networks via Lazy Propagation ICML 2023
Fast Saturating Gate for Learning Long Time Scales with Recurrent Neural Networks AAAI 2023