conftrace_
← Architectures
Deep Learning › Architectures ›

Transformers

10,397 papers

Papers per year

6
925
1792
'15
'20
'25

Papers

Alignment Attention by Matching Key and Query Distributions NIPS 2021
DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification NIPS 2021
Attention Bottlenecks for Multimodal Fusion NIPS 2021
Co-evolution Transformer for Protein Contact Prediction NIPS 2021
Hard-Attention for Scalable Image Classification NIPS 2021
TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up NIPS 2021
Decision Transformer: Reinforcement Learning via Sequence Modeling NIPS 2021
TNASP: A Transformer-based NAS Predictor with a Self-evolution Framework NIPS 2021
Attention Approximates Sparse Distributed Memory NIPS 2021
Augmented Shortcuts for Vision Transformers NIPS 2021
Neural Circuit Synthesis from Specification Patterns NIPS 2021
Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Prediction NIPS 2021
ResT: An Efficient Transformer for Visual Recognition NIPS 2021
Multimodal and Multilingual Embeddings for Large-Scale Speech Mining NIPS 2021
Learnable Fourier Features for Multi-dimensional Spatial Positional Encoding NIPS 2021
Transformer in Transformer NIPS 2021
CAPE: Encoding Relative Positions with Continuous Augmented Positional Embeddings NIPS 2021
Diffusion Normalizing Flow NIPS 2021
ProTo: Program-Guided Transformer for Program-Guided Tasks NIPS 2021
Scatterbrain: Unifying Sparse and Low-rank Attention NIPS 2021
Hash Layers For Large Sparse Models NIPS 2021
Long-Short Transformer: Efficient Transformers for Language and Vision NIPS 2021
Improved Transformer for High-Resolution GANs NIPS 2021
The Image Local Autoregressive Transformer NIPS 2021
All Tokens Matter: Token Labeling for Training Better Vision Transformers NIPS 2021