neural network optimization

Linear Transformers Are Secretly Fast Weight Programmers ICML 2021 Log-Likelihood-Ratio Cost Function as Objective Loss for Speaker Verification Systems Interspeech 2021 Loss Function Discovery for Object Detection via Convergence-Simulation Driven Search ICLR 2021 Loss Surface Simplexes for Mode Connecting Volumes and Fast Ensembling ICML 2021 Low-Fidelity Video Encoder Optimization for Temporal Action Localization NeurIPS 2021 LSH-SMILE: Locality Sensitive Hashing Accelerated Simulation and Learning NeurIPS 2021 Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation ACL 2021 MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge NeurIPS 2021 Mistify: Automating DNN Model Porting for On-Device Inference at the Edge NSDI 2021 MTAdam: Automatic Balancing of Multiple Training Loss Terms EMNLP 2021 Multiplicative Noise and Heavy Tails in Stochastic Optimization ICML 2021 NAS-OoD: Neural Architecture Search for Out-of-Distribution Generalization ICCV 2021 Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics ICLR 2021 Neural Reprojection Error: Merging Feature Learning and Camera Pose Estimation CVPR 2021 Nondeterminism and Instability in Neural Network Optimization ICML 2021 On ADMM in Deep Learning: Convergence and Saturation-Avoidance JMLR 2021 On Lipschitz Regularization of Convolutional Layers using Toeplitz Matrix Theory AAAI 2021 Only Time Can Tell: Discovering Temporal Data for Temporal Modeling WACV 2021 On Monotonic Linear Interpolation of Neural Network Parameters ICML 2021 On the Adequacy of Untuned Warmup for Adaptive Optimization AAAI 2021 On the Importance of Hyperparameter Optimization for Model-based Reinforcement Learning AISTATS 2021 On the number of linear functions composing deep neural network: Towards a refined definition of neural networks complexity AISTATS 2021 On the Predictability of Pruning Across Scales ICML 2021 On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs) NeurIPS 2021 On Training Implicit Models NeurIPS 2021