conftrace_

parameter-efficient fine-tuning

736 papers

Explore in graph

Also known as

PEFT

Co-occurring keywords

low-rank adaptation (560) large language model (13587) model compression (3302) transfer learning (5449) parameter efficient fine-tuning (168) knowledge distillation (3725) few-shot learning (3398) domain adaptation (4595) vision-language model (2348) language model (4599)

Papers

Attribute Injection for Pretrained Language Models: A New Benchmark and an Efficient Method COLING 2022
Multilingual Domain Adaptation for NMT: Decoupling Language and Domain Information with Adapters EMNLP 2021
Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks ACL 2021
Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators IJCNLP 2021
Compacter: Efficient Low-Rank Hypercomplex Adapter Layers NIPS 2021
Prefix-Tuning: Optimizing Continuous Prompts for Generation ACL 2021
Lightweight Adapter Tuning for Multilingual Speech Translation ACL 2021
Parameter-Efficient Domain Knowledge Integration from Multiple Sources for Biomedical Pre-trained Language Models EMNLP 2021
Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks IJCNLP 2021
Robust Transfer Learning with Pretrained Language Models through Adapters ACL 2021
AdapterHub: A Framework for Adapting Transformers EMNLP 2020