← Keywords

transformer architecture

1555 papers

Explore in graph

Also known as

TTE STTR TGT DIT ENT BERT DETR ROBERTA TA

Co-occurring keywords

attention mechanism (3975) neural machine translation (2310) transformer model (1988) representation learning (6174) language model (4573) neural network (6616) self-attention mechanism (350) multimodal learning (4622) machine translation (2472) large language model (12755)

Papers

LT-LM: A Novel Non-Autoregressive Language Model for Single-Shot Lattice Rescoring INTERSPEECH 2021
Stochastic Attention Head Removal: A Simple and Effective Method for Improving Transformer Based ASR Models INTERSPEECH 2021
ViViT: A Video Vision Transformer ICCV 2021
Action-Conditioned 3D Human Motion Synthesis With Transformer VAE ICCV 2021
THUNDR: Transformer-Based 3D Human Reconstruction With Markers ICCV 2021
MobTCast: Leveraging Auxiliary Trajectory Forecasting for Human Mobility Prediction NIPS 2021
Noise Robust Acoustic Modeling for Single-Channel Speech Recognition Based on a Stream-Wise Transformer Architecture INTERSPEECH 2021
3DVG-Transformer: Relation Modeling for Visual Grounding on Point Clouds ICCV 2021
AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecasting ICCV 2021
Rethinking Transformer-Based Set Prediction for Object Detection ICCV 2021
Describing and Localizing Multiple Changes With Transformers ICCV 2021
Which transformer architecture fits my data? A vocabulary bottleneck in self-attention ICML 2021
Synthesizer: Rethinking Self-Attention for Transformer Models ICML 2021
SparseBERT: Rethinking the Importance Analysis in Self-attention ICML 2021
I-BERT: Integer-only BERT Quantization ICML 2021
Generating images with sparse representations ICML 2021
Perceiver: General Perception with Iterative Attention ICML 2021
Does Structure Matter? Encoding Documents for Machine Reading Comprehension NAACL 2021
Capturing Row and Column Semantics in Transformer Based Question Answering over Tables NAACL 2021
Transformer-Style Relational Reasoning with Dynamic Memory Updating for Temporal Network Modeling AAAI 2021
ESC: Redesigning WSD with Extractive Sense Comprehension NAACL 2021
A Package for Learning on Tabular and Text Data with Transformers NAACL 2021
AMR Parsing with Action-Pointer Transformer NAACL 2021
Answering Complex Queries in Knowledge Graphs with Bidirectional Sequence Encoders AAAI 2021
ACT: an Attentive Convolutional Transformer for Efficient Text Classification AAAI 2021