Transformers

HORSE: Hierarchical Representation for Large-Scale Neural Subset Selection NeurIPS 2024 How Are Metaphors Processed by Language Models? The Case of Analogies CoNLL 2024 How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers NeurIPS 2024 How does GPT-2 Predict Acronyms? Extracting and Understanding a Circuit via Mechanistic Interpretability AISTATS 2024 How do Transformers Perform In-Context Autoregressive Learning ? ICML 2024 How Effective Are State Space Models for Machine Translation? EMNLP 2024 How Far Can Transformers Reason? The Globality Barrier and Inductive Scratchpad NeurIPS 2024 How Much Context Does My Attention-Based ASR System Need? Interspeech 2024 How Smooth Is Attention? ICML 2024 How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computation ICLR 2024 How Transformers Learn Causal Structure with Gradient Descent ICML 2024 How Transformers Utilize Multi-Head Attention in In-Context Learning? A Case Study on Sparse Linear Regression NeurIPS 2024 Human and System Perspectives on the Expression of Irony: An Analysis of Likelihood Labels and Rationales COLING 2024 Human Motion Aware Text-to-Video Generation With Explicit Camera Control WACV 2024 Humanoid Locomotion as Next Token Prediction NeurIPS 2024 HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priors NeurIPS 2024 H-ViT: A Hierarchical Vision Transformer for Deformable Image Registration CVPR 2024 HW-TSC 2024 Submission for the SemEval-2024 Task 1: Semantic Textual Relatedness (STR) SemEval 2024 HW-TSC’s Participation in the WMT 2024 QEAPE Task EMNLP 2024 HybridBERT - Making BERT Pretraining More Efficient Through Hybrid Mixture of Attention Mechanisms NAACL 2024 HybridGait: A Benchmark for Spatial-Temporal Cloth-Changing Gait Recognition with Hybrid Explorations AAAI 2024 Hybrid Sharing for Multi-Label Image Classification ICLR 2024 Hybrid-Supervised Dual-Search: Leveraging Automatic Learning for Loss-Free Multi-Exposure Image Fusion AAAI 2024 Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers NeurIPS 2024 HydraViT: Stacking Heads for a Scalable ViT NeurIPS 2024