Skip to content
conftrace_

activation memory

11 papers

Explore in graph

Co-occurring keywords · papers mentioning both

memory optimization (4) large language model (4) parameter-efficient fine-tuning (3) pipeline parallelism (2) memory efficiency (2) training efficiency (2) model compression (2) throughput optimization (1) backward propagation (1) transformer training (1)

Papers

FlexLLM: Token-Level Co-Serving of LLM Inference and Finetuning with SLO Guarantees NSDI 2026 Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning ICML 2025 PaCA: Partial Connection Adaptation for Efficient Fine-Tuning ICLR 2025 PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization ICML 2025 AutoChunk: Automated Activation Chunk for Memory-Efficient Deep Learning Inference ICLR 2024 DropBP: Accelerating Fine-Tuning of Large Language Models by Dropping Backward Propagation NeurIPS 2024 FedMef: Towards Memory-efficient Federated Dynamic Pruning CVPR 2024 Pipeline Parallelism with Controllable Memory NeurIPS 2024 Rockmate: an Efficient, Fast, Automatic and Generic Tool for Re-materialization in PyTorch ICML 2023 Softmax Output Approximation for Activation Memory-Efficient Training of Attention-based Networks NeurIPS 2023 Efficient Combination of Rematerialization and Offloading for Training DNNs NeurIPS 2021