conftrace_

weight decomposition

8 papers

Explore in graph

Co-occurring keywords

model compression (3302) low-rank adaptation (560) large language model (13587) adapter extraction (2) parameter-efficient fine-tuning (736) language model (4599) low-rank approximation (323) network pruning (183) multimodal model (110) student network (45)

Papers

PHLoRA: data-free Post-hoc Low-Rank Adapter extraction from full-rank checkpoint AACL 2025
Assigning Distinct Roles to Quantized and Low-Rank Matrices Toward Optimal Weight Decomposition ACL 2025
PHLoRA: data-free Post-hoc Low-Rank Adapter extraction from full-rank checkpoint IJCNLP 2025
Mixture-of-Subspaces in Low-Rank Adaptation EMNLP 2024
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning NIPS 2024
Surgical Feature-Space Decomposition of LLMs: Why, When and How? ACL 2024
Few Sample Knowledge Distillation for Efficient Network Compression CVPR 2020
Neuron Merging: Compensating for Pruned Neurons NIPS 2020