Neural Network Optimization

Differentiable Neural Architecture Search in Equivalent Space with Exploration Enhancement NeurIPS 2020 Differentiable Window for Dynamic Local Attention ACL 2020 Dilated Convolutional Attention Network for Medical Code Assignment from Clinical Text EMNLP 2020 Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures NeurIPS 2020 Directional convergence and alignment in deep learning NeurIPS 2020 DisARM: An Antithetic Gradient Estimator for Binary Latent Variables NeurIPS 2020 Disentangling Trainability and Generalization in Deep Neural Networks ICML 2020 Displacement-Invariant Matching Cost Learning for Accurate Optical Flow Estimation NeurIPS 2020 Dissecting Lottery Ticket Transformers: Structural and Behavioral Study of Sparse Neural Machine Translation EMNLP 2020 Do Subsampled Newton Methods Work for High-Dimensional Data? AAAI 2020 Do We Need Zero Training Loss After Achieving Zero Training Error? ICML 2020 DropNAS: Grouped Operation Dropout for Differentiable Architecture Search IJCAI 2020 DropNet: Reducing Neural Network Complexity via Iterative Pruning ICML 2020 DSNAS: Direct Neural Architecture Search Without Parameter Retraining CVPR 2020 Dual-Path Transformer Network: Direct Context-Aware Modeling for End-to-End Monaural Speech Separation Interspeech 2020 Dynamically Adjusting Transformer Batch Size by Monitoring Gradient Direction Change ACL 2020 Dynamical mean-field theory for stochastic gradient descent in Gaussian mixture classification NeurIPS 2020 Dynamical System Inspired Adaptive Time Stepping Controller for Residual Network Families AAAI 2020 Dynamical Systems as Temporal Feature Spaces JMLR 2020 Dynamic Hierarchical Mimicking Towards Consistent Optimization Objectives CVPR 2020 Dynamics of Deep Neural Networks and Neural Tangent Hierarchy ICML 2020 Editable Neural Networks ICLR 2020 Effect of Activation Functions on the Training of Overparametrized Neural Nets ICLR 2020 Efficient Derivative Computation for Cumulative B-Splines on Lie Groups CVPR 2020 Efficient Neural Architecture Search via Proximal Iterations AAAI 2020