vanishing gradient

The PID Controller Strikes Back: Classical Controller Helps Mitigate Barren Plateaus in Noisy Variational Quantum Circuits L4DC 2026 GLoRa: A Benchmark to Evaluate the Ability to Learn Long-Range Dependencies in Graphs ICLR 2025 H2O-SDF: Two-phase Learning for 3D Indoor Reconstruction using Object Surface Fields ICLR 2024 Only Strict Saddles in the Energy Landscape of Predictive Coding Networks? NeurIPS 2024 Recurrent neural networks: vanishing and exploding gradients are not the end of the story NeurIPS 2024 Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models ICML 2024 Universality of Linear Recurrences Followed by Non-linear Projections: Finite-Width Guarantees and Benefits of Complex Eigenvalues ICML 2024 Vanishing Gradients in Reinforcement Finetuning of Language Models ICLR 2024 Expected Gradients of Maxout Networks and Consequences to Parameter Initialization ICML 2023 Gradient Flossing: Improving Gradient Descent through Dynamic Control of Jacobians NeurIPS 2023 On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology ICML 2023 Why Capsule Neural Networks Do Not Scale: Challenging the Dynamic Parse-Tree Assumption AAAI 2023 AFRNN: Stable RNN with Top Down Feedback and Antisymmetry ACML 2022 Clipped Hyperbolic Classifiers Are Super-Hyperbolic Classifiers CVPR 2022 On the difficulty of learning chaotic dynamics with RNNs NeurIPS 2022 Vanishing Curvature in Randomly Initialized Deep ReLU Networks AISTATS 2022 A unified framework for Hamiltonian deep neural networks L4DC 2021 Implicit Bias of Linear RNNs ICML 2021 On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines ICLR 2021 Shuffling Recurrent Neural Networks AAAI 2021 Time Adaptive Recurrent Neural Network CVPR 2021 UnICORNN: A recurrent model for learning very long time dependencies ICML 2021 Beyond exploding and vanishing gradients: analysing RNN training using attractors and smoothness AISTATS 2020 Eigenvalue Normalized Recurrent Neural Networks for Short Term Memory AAAI 2020 Linear Antisymmetric Recurrent Neural Networks L4DC 2020