conftrace_

weight matrice

6 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (4) model compression (4) weight matrix (2) row-column update (1) row-column fine-tuning (1) weight matrix update (1) layer-selective rank reduction (1) hessian (1) heavy-tailed (1) jacobian (1)

Papers

Models of Heavy-Tailed Mechanistic Universality ICML 2025 ProcrustesGPT: Compressing LLMs with Structured Matrices and Orthogonal Transformations ACL 2025 RoCoFT: Efficient Finetuning of Large Language Models with Row-Column Updates ACL 2025 OneBit: Towards Extremely Low-bit Large Language Models NeurIPS 2024 The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction ICLR 2024 Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning JMLR 2021