conftrace_

low-rank adaptation

560 papers

Explore in graph

Also known as

LRA LORA

Co-occurring keywords

parameter-efficient fine-tuning (736) large language model (13587) model compression (3302) parameter efficient fine-tuning (168) diffusion model (3751) mixture of expert (640) transfer learning (5449) knowledge distillation (3725) catastrophic forgetting (958) multi-task learning (2575)

Papers

LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin ACL 2024
Multimodal Instruction Tuning with Conditional Mixture of LoRA ACL 2024
Structured Unrestricted-Rank Matrices for Parameter Efficient Finetuning NIPS 2024
$\textit{Trans-LoRA}$: towards data-free Transferable Parameter Efficient Finetuning NIPS 2024
Repurposing Language Models into Embedding Models: Finding the Compute-Optimal Recipe NIPS 2024
Sparse High Rank Adapters NIPS 2024
FouRA: Fourier Low-Rank Adaptation NIPS 2024
Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learner NIPS 2024
PRILoRA: Pruned and Rank-Increasing Low-Rank Adaptation EACL 2024
Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca EACL 2024
SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data NIPS 2024
Fast Forwarding Low-Rank Training EMNLP 2024
InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning CVPR 2024
Adapters Strike Back CVPR 2024
MTLoRA: Low-Rank Adaptation Approach for Efficient Multi-Task Learning CVPR 2024
MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning EMNLP 2024
FeedForward at SemEval-2024 Task 10: Trigger and sentext-height enriched emotion analysis in multi-party conversations NAACL 2024
Efficient Adaptation of Pre-trained Vision Transformer via Householder Transformation NIPS 2024
Mixture of Adversarial LoRAs: Boosting Robust Generalization in Meta-Tuning NIPS 2024
Bridging The Gap between Low-rank and Orthogonal Adaptation via Householder Reflection Adaptation NIPS 2024
SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors NIPS 2024
HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning NIPS 2024
VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks NIPS 2024
Visual Perception by Large Language Model’s Weights NIPS 2024
Wings: Learning Multimodal LLMs without Text-only Forgetting NIPS 2024