conftrace_

low-rank adaptation

560 papers

Explore in graph

Also known as

LRA LORA

Co-occurring keywords

parameter-efficient fine-tuning (736) large language model (13587) model compression (3302) parameter efficient fine-tuning (168) diffusion model (3751) mixture of expert (640) transfer learning (5449) knowledge distillation (3725) catastrophic forgetting (958) multi-task learning (2575)

Papers

Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent EMNLP 2024
AlphaLoRA: Assigning LoRA Experts Based on Layer Training Quality EMNLP 2024
ApiQ: Finetuning of 2-Bit Quantized Large Language Model EMNLP 2024
FanLoRA: Fantastic LoRAs and Where to Find Them in Large Language Model Fine-tuning EMNLP 2024
QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning EMNLP 2024
BSharedRAG: Backbone Shared Retrieval-Augmented Generation for the E-commerce Domain EMNLP 2024
LoRAN: Improved Low-Rank Adaptation by a Non-Linear Transformation EMNLP 2024
Instance-Level Dynamic LoRAs Composition for Cross-Task Generalization EMNLP 2024
RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization EMNLP 2024
LaRA: Large Rank Adaptation for Speech and Text Cross-Modal Learning in Large Language Models EMNLP 2024
Efficient Low-rank Backpropagation for Vision Transformer Adaptation NIPS 2023
HyperTuning: Toward Adapting Large Language Models without Back-propagation ICML 2023
PILLOW: Enhancing Efficient Instruction Fine-tuning via Prompt Matching EMNLP 2023
GPT-2 Metadata Pretraining Towards Instruction Finetuning for Ukrainian EACL 2023
Composing Parameter-Efficient Modules with Arithmetic Operation NIPS 2023
GPT4Tools: Teaching Large Language Model to Use Tools via Self-instruction NIPS 2023
Language Models Meet World Models: Embodied Experiences Enhance Language Models NIPS 2023
Empowering Knowledge Discovery from Scientific Literature: A novel approach to Research Artifact Analysis EMNLP 2023
Decomposed Prompt Tuning via Low-Rank Reparameterization EMNLP 2023
Steering Large Language Models for Machine Translation with Finetuning and In-Context Learning EMNLP 2023
YNU-HPCC at WASSA-2023 Shared Task 1: Large-scale Language Model with LoRA Fine-Tuning for Empathy Detection and Emotion Classification ACL 2023
Orthogonal Subspace Learning for Language Model Continual Learning EMNLP 2023
1% VS 100%: Parameter-Efficient Low Rank Adapter for Dense Predictions CVPR 2023
Fine-Tuning Language Models with Just Forward Passes NIPS 2023
Sparse Low-rank Adaptation of Pre-trained Language Models EMNLP 2023