conftrace_

parameter efficient fine-tuning

168 papers

Explore in graph

Also known as

PEFT

Co-occurring keywords

large language model (13587) low-rank adaptation (560) parameter-efficient fine-tuning (736) model compression (3302) transfer learning (5449) language model (4599) domain adaptation (4595) knowledge distillation (3725) few-shot learning (3398) prompt tuning (391)

Papers

Advancing Parameter Efficiency in Fine-tuning via Representation Editing ACL 2024
Forgetting before Learning: Utilizing Parametric Arithmetic for Knowledge Updating in Large Language Models ACL 2024
A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques ACL 2024
Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue EMNLP 2024
BIPEFT: Budget-Guided Iterative Search for Parameter Efficient Fine-Tuning of Large Pretrained Language Models EMNLP 2024
LaRA: Large Rank Adaptation for Speech and Text Cross-Modal Learning in Large Language Models EMNLP 2024
HyperLoRA: Efficient Cross-task Generalization via Constrained Low-Rank Adapters Generation EMNLP 2024
Updating CLIP to Prefer Descriptions Over Captions EMNLP 2024
Instruction Fine-Tuning: Does Prompt Loss Matter? EMNLP 2024
TL-CL: Task And Language Incremental Continual Learning EMNLP 2024
LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction CVPR 2024
Be Confident in What You Know: Bayesian Parameter Efficient Fine-Tuning of Vision Foundation Models NIPS 2024
VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks NIPS 2024
Prompt Tuning Strikes Back: Customizing Foundation Models with Low-Rank Prompt Adaptation NIPS 2024
FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations NIPS 2024
Structured Unrestricted-Rank Matrices for Parameter Efficient Finetuning NIPS 2024
GKT: A Novel Guidance-Based Knowledge Transfer Framework For Efficient Cloud-edge Collaboration LLM Deployment ACL 2024
STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models ACL 2024
XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts ACL 2024
Generalizability of Mixture of Domain-Specific Adapters from the Lens of Signed Weight Directions and its Application to Effective Model Pruning ACL 2024
nlp_enjoyers at TextGraphs-17 Shared Task: Text-Graph Representations for Knowledge Graph Question Answering using all-MPNet ACL 2024
Parameter Efficient Self-Supervised Geospatial Domain Adaptation CVPR 2024
Stochastic Fine-Tuning of Language Models Using Masked Gradients EMNLP 2024
LoRASC: Expressive and Generalizable Low-rank Adaptation for Large Models via Slow Cascaded Learning EMNLP 2024
Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent EMNLP 2024