← Keywords

transformer architecture

1555 papers

Explore in graph

Also known as

TTE STTR TGT DIT ENT BERT DETR ROBERTA TA

Co-occurring keywords

attention mechanism (3975) neural machine translation (2310) transformer model (1988) representation learning (6174) language model (4573) neural network (6616) self-attention mechanism (350) multimodal learning (4622) machine translation (2472) large language model (12755)

Papers

Flow-Guided Sparse Transformer for Video Deblurring ICML 2022
DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale ICML 2022
Transformer-based Objective-reinforced Generative Adversarial Network to Generate Desired Molecules IJCAI 2022
Triformer: Triangular, Variable-Specific Attentions for Long Sequence Multivariate Time Series Forecasting IJCAI 2022
Geometric Transformer for End-to-End Molecule Properties Prediction IJCAI 2022
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention IJCAI 2022
Efficient Transformer-based Speech Enhancement Using Long Frames and STFT Magnitudes INTERSPEECH 2022
End-to-End Joint Modeling of Conversation History-Dependent and Independent ASR Systems with Multi-History Training INTERSPEECH 2022
A Deep Learning Platform for Language Education Research and Development INTERSPEECH 2022
A compact transformer-based GAN vocoder INTERSPEECH 2022
LCTR: On Awakening the Local Continuity of Transformer for Weakly Supervised Object Localization AAAI 2022
Improving 360 Monocular Depth Estimation via Non-local Dense Prediction Transformer and Joint Supervised and Self-Supervised Learning AAAI 2022
RETRACTED: Pan-Sharpening with Customized Transformer and Invertible Neural Network AAAI 2022
Weakly-Supervised Salient Object Detection Using Point Supervision AAAI 2022
Shrinking Temporal Attention in Transformers for Video Action Recognition AAAI 2022
Diaformer: Automatic Diagnosis via Symptoms Sequence Generation AAAI 2022
Are Vision-Language Transformers Learning Multimodal Representations? A Probing Perspective AAAI 2022
Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization ACL 2022
IAM: A Comprehensive and Large-Scale Dataset for Integrated Argument Mining Tasks ACL 2022
ExtEnD: Extractive Entity Disambiguation ACL 2022
ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generation ACL 2022
Vision-Language Pretraining: Current Trends and the Future ACL 2022
Characterizing the Efficiency vs. Accuracy Trade-off for Long-Context NLP Models ACL 2022
Long-range Sequence Modeling with Predictable Sparse Attention ACL 2022
AbductionRules: Training Transformers to Explain Unexpected Inputs ACL 2022