gradient vanishing

Identifying nonlinear dynamical systems with multiple time scales and long-range dependencies ICLR 2021 SBO-RNN: Reformulating Recurrent Neural Networks via Stochastic Bilevel Optimization NeurIPS 2021 Time Adaptive Recurrent Neural Network CVPR 2021 Temporal Pyramid Recurrent Neural Network AAAI 2020 AntisymmetricRNN: A Dynamical System View on Recurrent Neural Networks ICLR 2019 Backbone Cannot Be Trained at Once: Rolling Back to Pre-Trained Network for Person Re-Identification AAAI 2019 Beyond Backprop: Online Alternating Minimization with Auxiliary Variables ICML 2019 DTMT: A Novel Deep Transition Architecture for Neural Machine Translation AAAI 2019 Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention EMNLP 2019 Lifted Proximal Operator Machines AAAI 2019 How to Start Training: The Effect of Initialization and Architecture NeurIPS 2018 Layer Trajectory LSTM Interspeech 2018 All You Need Is Beyond a Good Init: Exploring Better Solution for Training Extremely Deep Convolutional Neural Networks With Orthonormality and Modulation CVPR 2017 Self-Normalizing Neural Networks NeurIPS 2017 Unitary Evolution Recurrent Neural Networks ICML 2016