conftrace_

gradient gating

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

adaptive gradient gating (1) representation degeneration (1) graph neural network (1) token embedding (1) node classification (1) language model (1) message passing (1) neural text generation (1) language modeling (1) text generation (1)

Papers

Gradient Gating for Deep Multi-Rate Learning on Graphs ICLR 2023 Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings ACL 2022