conftrace_
← Authors

Giancarlo Kerg

4 papers · 2019–2022 · 2 conferences · across top CS/AI conferences

Achievements

Jump to papers ↓
🌍 Conference Polyglot (2) 🌉 Interdisciplinary Bridge 🧭 Keyword Pioneer 🐝 Cross-Pollinator (15)

Conferences

ICLR (2) NIPS (2)

Top co-authors

Yoshua Bengio (4) Guillaume Lajoie (3) Kyle Goyette (2) Bhargav Kanuparthi (2) Pierre-Luc Bacon (1) Tristan Deleu (1) Nan Rosemary Ke (1) Eugene Vorontsov (1) Gauthier Gidel (1) Leo Feng (1)

Keywords

vanishing gradient (2) long-term dependency (1) gradient propagation (1) recurrent network (1) orthogonal matrix (1) memory consolidation (1) long term dependency (1) non-normal rnn (1) schur decomposition (1) orthogonal rnn (1) recurrent neural network (1) transient dynamics (1)

Papers

Continuous-Time Meta-Learning with Forward Mode Differentiation ICLR 2022 Untangling tradeoffs between recurrence and self-attention in artificial neural networks NIPS 2020 Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamics NIPS 2019 h-detach: Modifying the LSTM Gradient Towards Better Optimization ICLR 2019