Skip to content
conftrace_

attention pattern

50 papers

Papers

VLA-Mark: A cross modal watermark for large vision-language alignment models EMNLP 2025 When Men Bite Dogs: Testing Good-Enough Parsing in Turkish with Humans and Large Language Models NAACL 2025 LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models NAACL 2024 PAD: A Robustness Enhancement Ensemble Method via Promoting Attention Diversity COLING 2024 Pruning for Protection: Increasing Jailbreak Resistance in Aligned LLMs Without Fine-Tuning EMNLP 2024 The Lou Dataset - Exploring the Impact of Gender-Fair Language in German Text Classification EMNLP 2024 Attention-Enhancing Backdoor Attacks Against BERT-based Models EMNLP 2023 Optimal Transport for Unsupervised Hallucination Detection in Neural Machine Translation ACL 2023 Towards a Mechanistic Interpretation of Multi-Step Reasoning Capabilities of Language Models EMNLP 2023 Transformers are uninterpretable with myopic methods: a case study with bounded Dyck grammars NeurIPS 2023 Unnatural language processing: How do language models handle machine-generated prompts? EMNLP 2023 Can Transformer be Too Compositional? Analysing Idiom Processing in Neural Machine Translation ACL 2022 Characterizing Verbatim Short-Term Memory in Neural Language Models CoNLL 2022 Entropy- and Distance-Based Predictors From GPT-2 Attention Patterns Predict Reading Times Over and Above GPT-2 Surprisal EMNLP 2022 GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformers NAACL 2022 How Conservative are Language Models? Adapting to the Introduction of Gender-Neutral Pronouns NAACL 2022 Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentation EMNLP 2022 Improving compositional generalization for multi-step quantitative reasoning in question answering EMNLP 2022 Learning Adaptive Axis Attentions in Fine-tuning: Beyond Fixed Sparse Attention Patterns ACL 2022 Memformer: A Memory-Augmented Transformer for Sequence Modeling AACL 2022 Outlier Dimensions that Disrupt Transformers are Driven by Frequency EMNLP 2022 Incorporating Residual and Normalization Layers into Analysis of Masked Language Models EMNLP 2021 Fixed Encoder Self-Attention Patterns in Transformer-Based Machine Translation EMNLP 2020 How Far Does BERT Look At: Distance-based Clustering and Analysis of BERT’s Attention COLING 2020 Revealing the Dark Secrets of BERT EMNLP 2019