Skip to content
conftrace_
2025 ICML ICML 2025

RepLoRA: Reparameterizing Low-rank Adaptation via the Perspective of Mixture of Experts

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Tuan Truong, Chau Nguyen, Huy Nguyen, Minh Le, Trung Le, nhật Hồ

Topics

Machine Learning > Optimization & Theory > Optimization Deep Learning > Architectures > Transformers Artificial Intelligence > Core AI > Large Language Models

Keywords

mixture of expert low-rank matrix estimation efficient fine-tuning loras mlp reparameterization
Download PDF