conftrace_

embedding dimension

16 papers

Explore in graph

Co-occurring keywords

information retrieval (1514) large language model (13587) dense retrieval (281) knowledge distillation (3725) attention mechanism (4001) dimensionality reduction (720) transformer architecture (1560) model compression (3302) multi-head attention (172) word embedding (1764)

Papers

Learning to Select: Query-Aware Adaptive Dimension Selection for Dense Retrieval ACL 2026
Understanding Token Probability Encoding in Output Embeddings COLING 2025
Matryoshka-Adaptor: Unsupervised and Supervised Tuning for Smaller Embedding Dimensions EMNLP 2024
DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models NIPS 2024
The Effective Number of Shared Dimensions Between Paired Datasets AISTATS 2024
Linguistic Collapse: Neural Collapse in (Large) Language Models NIPS 2024
Embedding Dimension of Contrastive Learning and $k$-Nearest Neighbors NIPS 2024
Computationally Efficient High-Dimensional Bayesian Optimization via Variable Selection AUTOML 2023
Representational Strengths and Limitations of Transformers NIPS 2023
Complex-to-Real Sketches for Tensor Products with Applications to the Polynomial Kernel AISTATS 2023
In defense of dual-encoders for neural ranking ICML 2022
The Curse of Dense Low-Dimensional Information Retrieval for Large Index Sizes IJCNLP 2021
Embedding Dimension of Polyhedral Losses COLT 2020
Low-Rank Bottleneck in Multi-head Attention Models ICML 2020
Query-Key Normalization for Transformers EMNLP 2020
The Pupil Has Become the Master: Teacher-Student Model-Based Word Embedding Distillation with Ensemble Learning IJCAI 2019