Skip to content
conftrace_
2024 ICML ICML 2024

LESS: Selecting Influential Data for Targeted Instruction Tuning

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Mengzhou Xia, Sadhika Malladi, Suchin Gururangan, Sanjeev Arora, Danqi Chen

Topics

Artificial Intelligence > Learning Paradigms > Transfer Learning Machine Learning > Optimization & Theory > Optimization Artificial Intelligence > Core AI > Large Language Models

Keywords

instruction tuning adam optimizer influence estimation gradient datastore low-rank gradient similarity search transferable data
Download PDF