low-rank adaptation

Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning ACL 2024 LinChance-NTU for Unconstrained WMT2024 Literary Translation EMNLP 2024 LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning NeurIPS 2024 LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models ACL 2024 LoftQ: LoRA-Fine-Tuning-aware Quantization for Large Language Models ICLR 2024 LoNAS: Elastic Low-Rank Adapters for Efficient Large Language Models COLING 2024 LoRA+: Efficient Low Rank Adaptation of Large Models ICML 2024 LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks ACL 2024 LoRA-GA: Low-Rank Adaptation with Gradient Approximation NeurIPS 2024 LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Models EMNLP 2024 LoRA Meets Dropout under a Unified Framework ACL 2024 LoRA-MER: Low-Rank Adaptation of Pre-Trained Speech Models for Multimodal Emotion Recognition Using Mutual Information Interspeech 2024 LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin ACL 2024 LoRAN: Improved Low-Rank Adaptation by a Non-Linear Transformation EMNLP 2024 LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning ACL 2024 LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wild ACL 2024 LoRASC: Expressive and Generalizable Low-rank Adaptation for Large Models via Slow Cascaded Learning EMNLP 2024 LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASR Interspeech 2024 LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models NAACL 2024 Low-Rank Adaptation for Multilingual Summarization: An Empirical Study NAACL 2024 Low-Rank Knowledge Decomposition for Medical Foundation Models CVPR 2024 Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach CVPR 2024 MACE: Mass Concept Erasure in Diffusion Models CVPR 2024 MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language Models ACL 2024 MELO: Enhancing Model Editing with Neuron-Indexed Dynamic LoRA AAAI 2024