← Keywords

transformer architecture

1555 papers

Explore in graph

Also known as

TTE STTR TGT DIT ENT BERT DETR ROBERTA TA

Co-occurring keywords

attention mechanism (3975) neural machine translation (2310) transformer model (1988) representation learning (6174) language model (4573) neural network (6616) self-attention mechanism (350) multimodal learning (4622) machine translation (2472) large language model (12755)

Papers

mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video ICML 2023
SLIBO-Net: Floorplan Reconstruction via Slicing Box Representation with Local Geometry Regularization NIPS 2023
Transformer-based Hebrew NLP models for Short Answer Scoring in Biology ACL 2023
Molformer: Motif-Based Transformer on 3D Heterogeneous Molecular Graphs AAAI 2023
Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution CVPR 2023
A Domain-Knowledge-Inspired Music Embedding Space and a Novel Attention Mechanism for Symbolic Music Modeling AAAI 2023
Scaling Laws for Multilingual Neural Machine Translation ICML 2023
Multi-Modal Gait Recognition via Effective Spatial-Temporal Feature Fusion CVPR 2023
VIMA: Robot Manipulation with Multimodal Prompts ICML 2023
One-to-Few Label Assignment for End-to-End Dense Detection CVPR 2023
Tencent-MVSE: A Large-Scale Benchmark Dataset for Multi-Modal Video Similarity Evaluation CVPR 2022
Multi-Agent Reinforcement Learning is a Sequence Modeling Problem NIPS 2022
RePFormer: Refinement Pyramid Transformer for Robust Facial Landmark Detection IJCAI 2022
Sinkformers: Transformers with Doubly Stochastic Attention AISTATS 2022
Where Does Linguistic Information Emerge in Neural Language Models? Measuring Gains and Contributions across Layers COLING 2022
A Closer Look at Parameter Contributions When Training Neural Language and Translation Models COLING 2022
A Survey of Vision-Language Pre-Trained Models IJCAI 2022
ByT5 model for massively multilingual grapheme-to-phoneme conversion INTERSPEECH 2022
From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers ICML 2022
Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modeling ICML 2022
Retroformer: Pushing the Limits of End-to-end Retrosynthesis Transformer ICML 2022
Multi Resolution Analysis (MRA) for Approximate Self-Attention ICML 2022
Transformer-based Localization from Embodied Dialog with Large-scale Pre-training IJCNLP 2022
OSSEM: one-shot speaker adaptive speech enhancement using meta learning INTERSPEECH 2022
Speech Separation for an Unknown Number of Speakers Using Transformers With Encoder-Decoder Attractors INTERSPEECH 2022