conftrace_

extended transformer construction

1 paper

Explore in graph

Also known as

ETC

Co-occurring keywords · papers mentioning both

global-local attention (1) long input (1) structured input (1) relative position encoding (1) contrastive predictive coding (1) transformer architecture (1)

Papers

ETC: Encoding Long and Structured Inputs in Transformers EMNLP 2020