conftrace_

model offloading

6 papers

Explore in graph

Co-occurring keywords

large language model (13587) memory optimization (114) model compression (3302) low-bit quantization (39) language model fine-tuning (236) parameter efficient tuning (72) model consistency (20) inference monitoring (1) logit analysis (6) open-source model (27)

Papers

Practical Offloading for Fine-Tuning LLM on Commodity GPU via Learned Sparse Projectors AAAI 2025
User-side Model Consistency Monitoring for Open Source Large Language Models Inference Services ACL 2025
SpeedLoader: An I/O efficient scheme for heterogeneous and distributed LLM operation NIPS 2024
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU ICML 2023
Petals: Collaborative Inference and Fine-tuning of Large Models ACL 2023
BMInf: An Efficient Toolkit for Big Model Inference and Tuning ACL 2022