Skip to content
conftrace_

distributed fine-tuning

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

gpu memory estimation (1) multi-gpu setup (1) large language model fine-tuning (1) large language model (1) transformer model (1) keystroke saving (1) perplexity reduction (1) memory optimization (1) model fine-tuning (1) language model (1)

Papers

LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs IJCAI 2024 Distributed Fine-tuning of Language Models on Private Data ICLR 2018