conftrace_

attention head

146 papers

Explore in graph

Co-occurring keywords

attention mechanism (4001) large language model (13587) language model (4599) mechanistic interpretability (133) model compression (3302) transformer model (1996) in-context learning (1405) representation learning (6206) transformer architecture (1560) model pruning (237)

Papers

Llama See, Llama Do: A Mechanistic Perspective on Contextual Entrainment and Distraction in LLMs ACL 2025
Analyzing the Rapid Generalization of SFT via the Perspective of Attention Head Activation Patterns ACL 2025
SEAL: Scaling to Emphasize Attention for Long-Context Retrieval ACL 2025
Short-circuiting Shortcuts: Mechanistic Investigation of Shortcuts in Text Classification CONLL 2025
Interpreting Language Models Through Concept Descriptions: A Survey EMNLP 2025
Short-circuiting Shortcuts: Mechanistic Investigation of Shortcuts in Text Classification ACL 2025
Learning Task Representations from In-Context Learning ACL 2025
Evil twins are not that evil: Qualitative insights into machine-generated prompts EMNLP 2025
Bias A-head? Analyzing Bias in Transformer-Based Language Model Attention Heads NAACL 2025
Revealing the Deceptiveness of Knowledge Editing: A Mechanistic Analysis of Superficial Editing ACL 2025
Dissecting Persona-Driven Reasoning in Language Models via Activation Patching EMNLP 2025
Linguistically Grounded Analysis of Language Models using Shapley Head Values NAACL 2025
Benchmarking and Understanding Compositional Relational Reasoning of LLMs AAAI 2025
Unveiling Visual Perception in Language Models: An Attention Head Analysis Approach CVPR 2025
Cooperative or Competitive? Understanding the Interaction between Attention Heads From A Game Theory Perspective ACL 2025
SparseMM: Head Sparsity Emerges from Visual Concept Responses in MLLMs ICCV 2025
Understanding and Controlling Repetition Neurons and Induction Heads in In-Context Learning IJCNLP 2025
Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases ACL 2025
Structured Pruning for Diverse Best-of-N Reasoning Optimization ACL 2025
Improving Contextual Faithfulness of Large Language Models via Retrieval Heads-Induced Optimization ACL 2025
Learn to Memorize: Scalable Continual Learning in Semiparametric Models with Mixture-of-Neighbors Induction Memory ACL 2025
Align Attention Heads Before Merging Them: An Effective Way for Converting MHA to GQA EMNLP 2025
Investigating Neurons and Heads in Transformer-based LLMs for Typographical Errors EMNLP 2025
Language Models Grow Less Humanlike beyond Phase Transition ACL 2025
How do autoregressive transformers solve full addition? EMNLP 2025