CLOVER: Cross-Layer Orthogonal Vectors Pruning

Fanxu Meng; Pingzhi Tang; Fan Jiang; Muhan Zhang

2025 ICML ICML 2025

CLOVER: Cross-Layer Orthogonal Vectors Pruning

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Fanxu Meng, Pingzhi Tang, Fan Jiang, Muhan Zhang

Topics

Machine Learning > Application Areas > Efficient Computing Deep Learning > Architectures > Transformers Artificial Intelligence > Core AI > Large Language Models

Keywords

attention mechanism singular value decomposition fine tuning pruning q-k v-o

Download PDF