long-range attention

attention mechanism (2) short-term attention (1) query-guided decoding (1) transformer model (1) lightweight convolutional neural network (1) long sequence (1) nlp evaluation (1) mobile inference (1) efficient transformer (1) mobile application (1)