conftrace_
← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3,648 papers

Papers per year

Papers

Gradient Descent on Neurons and its Link to Approximate Second-order Optimization ICML 2022
Real-Valued Backpropagation is Unsuitable for Complex-Valued Neural Networks NIPS 2022
Accelerating DETR Convergence via Semantic-Aligned Matching CVPR 2022
On Enforcing Better Conditioned Meta-Learning for Rapid Few-Shot Adaptation NIPS 2022
Adam Can Converge Without Any Modification On Update Rules NIPS 2022
A Unified Framework for Implicit Sinkhorn Differentiation CVPR 2022
Survey on Efficient Training of Large Neural Networks IJCAI 2022
Speeding up Transformer Decoding via an Attention Refinement Network COLING 2022
RetrieverTTS: Modeling Decomposed Factors for Text-Based Speech Insertion INTERSPEECH 2022
Scaled ReLU Matters for Training Vision Transformers AAAI 2022
NAS-VAD: Neural Architecture Search for Voice Activity Detection INTERSPEECH 2022
A Neural Pre-Conditioning Active Learning Algorithm to Reduce Label Complexity NIPS 2022
Vanishing Curvature in Randomly Initialized Deep ReLU Networks AISTATS 2022
Solving PDE-Constrained Control Problems Using Operator Learning AAAI 2022
Deterministic policy gradient: Convergence analysis UAI 2022
On the inductive bias of neural networks for learning read-once DNFs UAI 2022
AdwU-Net: Adaptive Depth and Width U-Net for Medical Image Segmentation by Differentiable Neural Architecture Search MIDL 2022
Towards understanding how momentum improves generalization in deep learning ICML 2022
Certified Neural Network Watermarks with Randomized Smoothing ICML 2022
Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings ACL 2022
PPT: Pre-trained Prompt Tuning for Few-shot Learning ACL 2022
GraN-GAN: Piecewise Gradient Normalization for Generative Adversarial Networks WACV 2022
Taylor-Lagrange Neural Ordinary Differential Equations: Toward Fast Training and Evaluation of Neural ODEs IJCAI 2022
Fast Finite Width Neural Tangent Kernel ICML 2022
Most Activation Functions Can Win the Lottery Without Excessive Depth NIPS 2022