conftrace_

attention head

186 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (36) language model (28) attention mechanism (28) mechanistic interpretability (25) vision-language model (14) in-context learning (14) model compression (14) representation learning (14) transformer model (11) transformer architecture (11)

Papers

The Stem Cell Hypothesis: Dilemma behind Multi-Task Learning with Transformer Encoders EMNLP 2021 BERTering RAMS: What and How Much does BERT Already Know About Event Arguments? - A Study on the RAMS Dataset EMNLP 2020 Heads-up! Unsupervised Constituency Parsing via Self-Attention Heads AACL 2020 Investigating Gender Bias in Language Models Using Causal Mediation Analysis NeurIPS 2020 On the weak link between importance and prunability of attention heads EMNLP 2020 What Does BERT with Vision Look At? ACL 2020 Adaptively Sparse Transformers EMNLP 2019 Are Sixteen Heads Really Better than One? NeurIPS 2019 Mixed Multi-Head Self-Attention for Neural Machine Translation EMNLP 2019 Sarah’s Participation in WAT 2019 EMNLP 2019 Multi-Head Attention with Disagreement Regularization EMNLP 2018