conftrace_
← Architectures
Deep Learning › Architectures ›

Transformers

9,294 papers

Papers per year

Papers

TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localization ICCV 2021
Anticipative Video Transformer ICCV 2021
Scalable Normalizing Flows for Permutation Invariant Densities ICML 2021
Fold2Seq: A Joint Sequence(1D)-Fold(3D) Embedding-based Generative Model for Protein Design ICML 2021
Learning Self-Modulating Attention in Continuous Time Space with Applications to Sequential Recommendation ICML 2021
SpreadsheetCoder: Formula Prediction from Semi-structured Context ICML 2021
ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases ICML 2021
Lipschitz normalization for self-attention layers with application to graph neural networks ICML 2021
Catformer: Designing Stable Transformers via Sensitivity Analysis ICML 2021
Attention is not all you need: pure attention loses rank doubly exponentially with depth ICML 2021
PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models ICML 2021
Generative Adversarial Transformers ICML 2021
LieTransformer: Equivariant Self-Attention for Lie Groups ICML 2021
Perceiver: General Perception with Iterative Attention ICML 2021
I-BERT: Integer-only BERT Quantization ICML 2021
The Lipschitz Constant of Self-Attention ICML 2021
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision ICML 2021
BASE Layers: Simplifying Training of Large, Sparse Models ICML 2021
Generating images with sparse representations ICML 2021
How could Neural Networks understand Programs? ICML 2021
BANG: Bridging Autoregressive and Non-autoregressive Generation with Large Scale Pretraining ICML 2021
SparseBERT: Rethinking the Importance Analysis in Self-attention ICML 2021
Not All Memories are Created Equal: Learning to Forget by Expiring ICML 2021
Synthesizer: Rethinking Self-Attention for Transformer Models ICML 2021
OmniNet: Omnidirectional Representations from Transformers ICML 2021