Parameter-Efficient Fine-Tuning

Contrastive Alignment of Vision to Language Through Parameter-Efficient Transfer Learning ICLR 2023 HyperTuning: Toward Adapting Large Language Models without Back-propagation ICML 2023 LPT: Long-tailed Prompt Tuning for Image Classification ICLR 2023 Memory-Efficient Fine-Tuning of Compressed Large Language Models via sub-4-bit Integer Quantization NeurIPS 2023 Mixture-of-Linguistic-Experts Adapters for Improving and Interpreting Pre-trained Language Models EMNLP 2023 Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learning ICLR 2023 Parameter-Efficient Fine-Tuning Design Spaces ICLR 2023 Parameter-Efficient Language Model Tuning with Active Learning in Low-Resource Settings EMNLP 2023 Parameter Efficient Multi-task Fine-tuning by Learning to Transfer Token-wise Prompts EMNLP 2023 Sparse Low-rank Adaptation of Pre-trained Language Models EMNLP 2023 LoRA: Low-Rank Adaptation of Large Language Models ICLR 2022 On Robust Prefix-Tuning for Text Classification ICLR 2022 Towards a Unified View of Parameter-Efficient Transfer Learning ICLR 2022 Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks ACL 2021 Prefix-Tuning: Optimizing Continuous Prompts for Generation ACL 2021