Transformers

Momentum Stiefel Optimizer, with Applications to Suitably-Orthogonal Attention, and Optimal Transport ICLR 2023 Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture NeurIPS 2023 Monocular Scene Reconstruction with 3D SDF Transformers ICLR 2023 MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining NeurIPS 2023 MOSO: Decomposing MOtion, Scene and Object for Video Prediction CVPR 2023 MOST: Multiple Object Localization with Self-Supervised Transformers for Object Discovery ICCV 2023 MotionBERT: A Unified Perspective on Learning Human Motion Representations ICCV 2023 Moving Forward by Moving Backward: Embedding Action Impact over Action Semantics ICLR 2023 MPCFORMER: FAST, PERFORMANT AND PRIVATE TRANSFORMER INFERENCE WITH MPC ICLR 2023 MPCViT: Searching for Accurate and Efficient MPC-Friendly Vision Transformer with Heterogeneous Attention ICCV 2023 MP-Former: Mask-Piloted Transformer for Image Segmentation CVPR 2023 mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video ICML 2023 MP-SENet: A Speech Enhancement Model with Parallel Denoising of Magnitude and Phase Spectra Interspeech 2023 mReFinED: An Efficient End-to-End Multilingual Entity Linking System EMNLP 2023 Mr-Fosdick at SemEval-2023 Task 5: Comparing Dataset Expansion Techniques for Non-Transformer and Transformer Models: Improving Model Performance through Data Augmentation SemEval 2023 MSCFFN: A New FFN with Multi-Space Cross to Accelerate Transformer EMNLP 2023 MTCue: Learning Zero-Shot Control of Extra-Textual Attributes by Leveraging Unstructured Context in Neural Machine Translation ACL 2023 MT-DETR: Robust End-to-End Multimodal Detection With Confidence Fusion WACV 2023 MulGT: Multi-Task Graph-Transformer with Task-Aware Knowledge Injection and Domain Knowledge-Driven Pooling for Whole Slide Image Analysis AAAI 2023 Multi-channel multi-speaker transformer for speech recognition Interspeech 2023 Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling ACL 2023 MultiCoNER v2: a Large Multilingual dataset for Fine-grained and Noisy Named Entity Recognition EMNLP 2023 Multi-doc Hybrid Summarization via Salient Representation Learning ACL 2023 Multi-Event Video-Text Retrieval ICCV 2023 Multi-Level Contrastive Learning for Self-Supervised Vision Transformers WACV 2023