gradient propagation

Stable ResNet AISTATS 2021 UnICORNN: A recurrent model for learning very long time dependencies ICML 2021 Improving the Gating Mechanism of Recurrent Neural Networks ICML 2020 Interpolation Technique to Speed Up Gradients Propagation in Neural ODEs NeurIPS 2020 Multiscale Collaborative Deep Models for Neural Machine Translation ACL 2020 Rethinking Skip Connection with Layer Normalization COLING 2020 Skip Connections Matter: On the Transferability of Adversarial Examples Generated with ResNets ICLR 2020 Training Quantized Neural Networks With a Full-Precision Auxiliary Module CVPR 2020 Untangling tradeoffs between recurrence and self-attention in artificial neural networks NeurIPS 2020 A Mean Field Theory of Batch Normalization ICLR 2019 DTMT: A Novel Deep Transition Architecture for Neural Machine Translation AAAI 2019 Linearized Multi-Sampling for Differentiable Image Transformation ICCV 2019 Soft Rasterizer: A Differentiable Renderer for Image-Based 3D Reasoning ICCV 2019 Independently Recurrent Neural Network (IndRNN): Building a Longer and Deeper RNN CVPR 2018 On the Local Hessian in Back-propagation NeurIPS 2018 Understanding Batch Normalization NeurIPS 2018 Deep Neural Machine Translation with Linear Associative Unit ACL 2017 On orthogonality and learning recurrent networks with long term dependencies ICML 2017 Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice NeurIPS 2017 Tunable Efficient Unitary Neural Networks (EUNN) and their application to RNNs ICML 2017