Skip to content
conftrace_
2024 ICML ICML 2024

DoRA: Weight-Decomposed Low-Rank Adaptation

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Shih-Yang Liu, Chien-Yi Wang, Hongxu Yin, Pavlo Molchanov, Yu-Chiang Frank Wang, Kwang-Ting Cheng, Min-Hung Chen

Topics

Machine Learning > Core Methods > Representation Learning Deep Learning > Architectures > Transformers Artificial Intelligence > Core AI > Large Language Models

Keywords

weight decomposition fine tuning large language model loras directional updates magnitude
Download PDF