neural network optimization

Scaling Laws for Acoustic Models Interspeech 2021 Searching Parameterized AP Loss for Object Detection NeurIPS 2021 SimiGrad: Fine-Grained Adaptive Batching for Large Scale Training using Gradient Similarity Measurement NeurIPS 2021 SKFAC: Training Neural Networks With Faster Kronecker-Factored Approximate Curvature CVPR 2021 SmBoP: Semi-autoregressive Bottom-up Semantic Parsing NAACL 2021 Sparse Deep Learning: A New Framework Immune to Local Traps and Miscalibration NeurIPS 2021 Step-Ahead Error Feedback for Distributed Training with Compressed Gradient AAAI 2021 Stochastic Attention Head Removal: A Simple and Effective Method for Improving Transformer Based ASR Models Interspeech 2021 Stochastic Whitening Batch Normalization CVPR 2021 Sub-Bit Neural Networks: Learning To Compress and Accelerate Binary Neural Networks ICCV 2021 TANDEM: Tracking and Dense Mapping in Real-time using Deep Multi-view Stereo CoRL 2021 The Flip Side of the Reweighted Coin: Duality of Adaptive Dropout and Regularization NeurIPS 2021 The Heavy-Tail Phenomenon in SGD ICML 2021 THOR, Trace-based Hardware-driven Layer-Oriented Natural Gradient Descent Computation AAAI 2021 Tied & Reduced RNN-T Decoder Interspeech 2021 Towards Efficient and Effective Adversarial Training NeurIPS 2021 Towards Efficient Tensor Decomposition-Based DNN Model Compression With Optimization Framework CVPR 2021 Towards Fast and Accurate Multi-Person Pose Estimation on Mobile Devices IJCAI 2021 Towards Memory-Efficient Neural Networks via Multi-Level In Situ Generation ICCV 2021 Towards Stable and Robust AdderNets NeurIPS 2021 Training Adaptive Computation for Open-Domain Question Answering with Computational Constraints ACL 2021 Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Bounds NeurIPS 2021 Training deep residual networks for uniform approximation guarantees L4DC 2021 TransTailor: Pruning the Pre-trained Model for Improved Transfer Learning AAAI 2021 Uncertainty-aware Binary Neural Networks IJCAI 2021