conftrace_

weight decomposition

10 papers

Explore in graph

Co-occurring keywords · papers mentioning both

model compression (8) large language model (4) low-rank adaptation (2) parameter-efficient fine-tuning (2) language model (2) low-rank approximation (2) network pruning (2) multimodal model (1) student network (1) commonsense reasoning (1)

Papers

Assigning Distinct Roles to Quantized and Low-Rank Matrices Toward Optimal Weight Decomposition ACL 2025 BitStack: Any-Size Compression of Large Language Models in Variable Memory Environments ICLR 2025 PHLoRA: data-free Post-hoc Low-Rank Adapter extraction from full-rank checkpoint IJCNLP 2025 RECAST: Reparameterized, Compact weight Adaptation for Sequential Tasks ICLR 2025 CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning NeurIPS 2024 DoRA: Weight-Decomposed Low-Rank Adaptation ICML 2024 Mixture-of-Subspaces in Low-Rank Adaptation EMNLP 2024 Surgical Feature-Space Decomposition of LLMs: Why, When and How? ACL 2024 Few Sample Knowledge Distillation for Efficient Network Compression CVPR 2020 Neuron Merging: Compensating for Pruned Neurons NeurIPS 2020