Transformers

Overcoming a Theoretical Limitation of Self-Attention ACL 2022 OW-DETR: Open-World Detection Transformer CVPR 2022 P3LM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training EMNLP 2022 PACE: Predictive and Contrastive Embedding for Unsupervised Action Segmentation IJCAI 2022 Pale Transformer: A General Vision Transformer Backbone with Pale-Shaped Attention AAAI 2022 Panoptic SegFormer: Delving Deeper Into Panoptic Segmentation With Transformers CVPR 2022 PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining NAACL 2022 Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognition Interspeech 2022 Paragraph-based Transformer Pre-training for Multi-Sentence Inference NAACL 2022 Parameter-Efficient Conformers via Sharing Sparsely-Gated Experts for End-to-End Speech Recognition Interspeech 2022 Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models COLING 2022 Parametric Visual Program Induction with Function Modularization ICML 2022 Paramixer: Parameterizing Mixing Links in Sparse Factors Works Better Than Dot-Product Self-Attention CVPR 2022 PARE: A Simple and Strong Baseline for Monolingual and Multilingual Distantly Supervised Relation Extraction ACL 2022 Partially-Random Initialization: A Smoking Gun for Binarization Hypothesis of BERT EMNLP 2022 Particle Transformer for Jet Tagging ICML 2022 Patch-Fool: Are Vision Transformers Always Robust Against Adversarial Perturbations? ICLR 2022 PatchFormer: An Efficient Point Transformer With Patch Attention CVPR 2022 Patch-Level Representation Learning for Self-Supervised Vision Transformers CVPR 2022 Penalizing Divergence: Multi-Parallel Translation for Low-Resource Languages of North America COLING 2022 PENTATRON: PErsonalized coNText-Aware Transformer for Retrieval-based cOnversational uNderstanding EMNLP 2022 Perceiver IO: A General Architecture for Structured Inputs & Outputs ICLR 2022 Periodic Graph Transformers for Crystal Material Property Prediction NeurIPS 2022 Peripheral Vision Transformer NeurIPS 2022 Persona-Guided Planning for Controlling the Protagonist’s Persona in Story Generation NAACL 2022