parameter-efficient fine-tuning

LMFlow: An Extensible Toolkit for Finetuning and Inference of Large Foundation Models NAACL 2024 LoFiT: Localized Fine-tuning on LLM Representations NeurIPS 2024 LoNAS: Elastic Low-Rank Adapters for Efficient Large Language Models COLING 2024 LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models ICLR 2024 LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks ACL 2024 LoRA-GA: Low-Rank Adaptation with Gradient Approximation NeurIPS 2024 LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Models EMNLP 2024 LoRA Meets Dropout under a Unified Framework ACL 2024 LoRAN: Improved Low-Rank Adaptation by a Non-Linear Transformation EMNLP 2024 LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning ACL 2024 LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wild ACL 2024 LoRASC: Expressive and Generalizable Low-rank Adaptation for Large Models via Slow Cascaded Learning EMNLP 2024 LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models NAACL 2024 Low-Rank Adaptation for Multilingual Summarization: An Empirical Study NAACL 2024 Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach CVPR 2024 LQ-LoRA: Low-rank plus Quantized Matrix Decomposition for Efficient Language Model Finetuning ICLR 2024 M2PT: Multimodal Prompt Tuning for Zero-shot Instruction Learning EMNLP 2024 MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language Models ACL 2024 MEFT: Memory-Efficient Fine-Tuning through Sparse Adapter ACL 2024 MELO: Enhancing Model Editing with Neuron-Indexed Dynamic LoRA AAAI 2024 MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning ACL 2024 Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning ICML 2024 Missing Modality Prediction for Unpaired Multimodal Learning via Joint Embedding of Unimodal Models ECCV 2024 Mixture-of-Subspaces in Low-Rank Adaptation EMNLP 2024 Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue EMNLP 2024