conftrace_

outlier dimension

5 papers

Explore in graph

Co-occurring keywords · papers mentioning both

language model (2) representation learning (2) cross-lingual semantic similarity (1) outlier phenomenon (1) representational quality (1) frequent word (1) large language model (1) isotropy enhancement (1) attention pattern (1) embedding analysis (1)

Papers

Not a nuisance but a useful heuristic: Outlier dimensions favor frequent tokens in language models EMNLP 2025 Exploring Anisotropy and Outliers in Multilingual Language Models for Cross-Lingual Semantic Sentence Similarity ACL 2023 Outlier Dimensions Encode Task Specific Knowledge EMNLP 2023 An Isotropy Analysis in the Multilingual BERT Embedding Space ACL 2022 Outlier Dimensions that Disrupt Transformers are Driven by Frequency EMNLP 2022