conftrace_

low-rank adaptation

560 papers

Explore in graph

Also known as

LRA LORA

Co-occurring keywords

parameter-efficient fine-tuning (736) large language model (13587) model compression (3302) parameter efficient fine-tuning (168) diffusion model (3751) mixture of expert (640) transfer learning (5449) knowledge distillation (3725) catastrophic forgetting (958) multi-task learning (2575)

Papers

Prompt Tuning Strikes Back: Customizing Foundation Models with Low-Rank Prompt Adaptation NIPS 2024
Compressing Large Language Models using Low Rank and Low Precision Decomposition NIPS 2024
Personalized LoRA for Human-Centered Text Understanding AAAI 2024
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models NIPS 2024
Unveiling LoRA Intrinsic Ranks via Salience Analysis NIPS 2024
Understanding Linear Probing then Fine-tuning Language Models from NTK Perspective NIPS 2024
Harmonizing Visual Text Comprehension and Generation NIPS 2024
STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models ACL 2024
Customizing Language Models with Instance-wise LoRA for Sequential Recommendation NIPS 2024
FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations NIPS 2024
DoRA: Enhancing Parameter-Efficient Fine-Tuning with Dynamic Rank Distribution ACL 2024
LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks ACL 2024
LoRA Meets Dropout under a Unified Framework ACL 2024
Speech-based Slot Filling using Large Language Models ACL 2024
LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning NIPS 2024
Panacea: Pareto Alignment via Preference Adaptation for LLMs NIPS 2024
Low-Rank Knowledge Decomposition for Medical Foundation Models CVPR 2024
Orthogonal Adaptation for Modular Customization of Diffusion Models CVPR 2024
Efficient Stitchable Task Adaptation CVPR 2024
Personalized Residuals for Concept-Driven Text-to-Image Generation CVPR 2024
Low-Rank Adaptation for Multilingual Summarization: An Empirical Study NAACL 2024
Towards One-to-Many Visual Question Answering EMNLP 2024
MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning EMNLP 2024
DeBERTa Beats Behemoths: A Comparative Analysis of Fine-Tuning, Prompting, and PEFT Approaches on LegalLensNER EMNLP 2024
LinChance-NTU for Unconstrained WMT2024 Literary Translation EMNLP 2024