conftrace_

orthogonality

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

arbitrary densities (1) sink token (1) dense initialization (1) sparse initialization (1) layer depth (1) givens rotation (1) dynamical isometry (1) cosine similarity (1) token importance (1) hidden state (1)

Papers

OrthoRank: Token Selection via Sink Token Orthogonality for Efficient LLM inference ICML 2025 Sparser, Better, Deeper, Stronger: Improving Static Sparse Training with Exact Orthogonal Initialization ICML 2024