conftrace_

parameter efficient fine-tuning

168 papers

Explore in graph

Also known as

PEFT

Co-occurring keywords

large language model (13587) low-rank adaptation (560) parameter-efficient fine-tuning (736) model compression (3302) transfer learning (5449) language model (4599) domain adaptation (4595) knowledge distillation (3725) few-shot learning (3398) prompt tuning (391)

Papers

RoQLlama: A Lightweight Romanian Adapted Language Model EMNLP 2024
RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization EMNLP 2024
S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity NIPS 2024
VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections NIPS 2024
EMVP: Embracing Visual Foundation Model for Visual Place Recognition with Centroid-Free Probing NIPS 2024
FeedForward at SemEval-2024 Task 10: Trigger and sentext-height enriched emotion analysis in multi-party conversations NAACL 2024
KInIT at SemEval-2024 Task 8: Fine-tuned LLMs for Multilingual Machine-Generated Text Detection NAACL 2024
KInIT at SemEval-2024 Task 8: Fine-tuned LLMs for Multilingual Machine-Generated Text Detection SEMEVAL 2024
Sparse Low-rank Adaptation of Pre-trained Language Models EMNLP 2023
Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization ACL 2023
On Enhancing Fine-Tuning for Pre-trained Language Models EMNLP 2023
Parameter Efficient Multi-task Fine-tuning by Learning to Transfer Token-wise Prompts EMNLP 2023
Trainable Projected Gradient Method for Robust Fine-Tuning CVPR 2023
OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models ACL 2023
SMoP: Towards Efficient and Effective Prompt Tuning with Sparse Mixture-of-Prompts EMNLP 2023
Leveraging Prefix Transfer for Multi-Intent Text Revision ACL 2023
Towards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning ACL 2023
Mini-Model Adaptation: Efficiently Extending Pretrained Models to New Languages via Aligned Shallow Training ACL 2023
Fixed Input Parameterization for Efficient Prompting ACL 2023
PIP: Parse-Instructed Prefix for Syntactically Controlled Paraphrase Generation ACL 2023
Using Bottleneck Adapters to Identify Cancer in Clinical Notes under Low-Resource Constraints ACL 2023
Petals: Collaborative Inference and Fine-tuning of Large Models ACL 2023
Parameter-Efficient Language Model Tuning with Active Learning in Low-Resource Settings EMNLP 2023
Adapter-tuning with Effective Token-dependent Representation Shift for Automatic Speech Recognition INTERSPEECH 2023
YANMTT: Yet Another Neural Machine Translation Toolkit ACL 2023