Skip to content
conftrace_

model offloading

6 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (5) memory optimization (4) model compression (2) heterogeneous computing (1) low-bit quantization (1) language model fine-tuning (1) model consistency (1) inference monitoring (1) logit analysis (1) open-source model (1)

Papers

Practical Offloading for Fine-Tuning LLM on Commodity GPU via Learned Sparse Projectors AAAI 2025 User-side Model Consistency Monitoring for Open Source Large Language Models Inference Services ACL 2025 SpeedLoader: An I/O efficient scheme for heterogeneous and distributed LLM operation NeurIPS 2024 FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU ICML 2023 Petals: Collaborative Inference and Fine-tuning of Large Models ACL 2023 BMInf: An Efficient Toolkit for Big Model Inference and Tuning ACL 2022