Transformers

On the In-context Generation of Language Models EMNLP 2024 On the Language Encoder of Contrastive Cross-modal Models ACL 2024 On the Minimal Degree Bias in Generalization on the Unseen for non-Boolean Functions ICML 2024 On the Power of Decision Trees in Auto-Regressive Language Modeling NeurIPS 2024 On the Robustness of Large Multimodal Models Against Image Adversarial Attacks CVPR 2024 On the Role of Attention Masks and LayerNorm in Transformers NeurIPS 2024 On the Role of Discrete Tokenization in Visual Representation Learning ICLR 2024 On the Similarity of Circuits across Languages: a Case Study on the Subject-verb Agreement Task EMNLP 2024 On the Surprising Effectiveness of Attention Transfer for Vision Transformers NeurIPS 2024 On the Theoretical Expressive Power and the Design Space of Higher-Order Graph Transformers AISTATS 2024 On the token distance modeling ability of higher RoPE attention dimension EMNLP 2024 On the Way to Lossless Compression of Language Transformers: Exploring Cross-Domain Properties of Quantization COLING 2024 OOVs in the Spotlight: How to Inflect Them? COLING 2024 Opening the Black Box: Unraveling the Classroom Dialogue Analysis (Student Abstract) AAAI 2024 Open-Vocabulary Object 6D Pose Estimation CVPR 2024 Open Vocabulary Semantic Scene Sketch Understanding CVPR 2024 Opponent Modeling with In-context Search NeurIPS 2024 OPUS: Occupancy Prediction Using a Sparse Set NeurIPS 2024 Orchid: Flexible and Data-Dependent Convolution for Sequence Modeling NeurIPS 2024 OSIC: A New One-Stage Image Captioner Coined IJCAI 2024 OTE: Exploring Accurate Scene Text Recognition Using One Token CVPR 2024 OtoBERT: Identifying Suffixed Verbal Forms in Modern Hebrew Literature EMNLP 2024 Outlier-aware Slicing for Post-Training Quantization in Vision Transformer ICML 2024 Outlier-Efficient Hopfield Layers for Large Transformer-Based Models ICML 2024 Outlier Reduction with Gated Attention for Improved Post-training Quantization in Large Sequence-to-sequence Speech Foundation Models Interspeech 2024