memory optimization

End-to-End Temporal Action Detection with 1B Parameters Across 1000 Frames CVPR 2024 Expanding Sparse Tuning for Low Memory Usage NeurIPS 2024 Fast and Memory-Efficient Video Diffusion Using Streamlined Inference NeurIPS 2024 Fast Vector Query Processing for Large Datasets Beyond GPU Memory with Reordered Pipelining NSDI 2024 FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision NeurIPS 2024 Full Parameter Fine-tuning for Large Language Models with Limited Resources ACL 2024 Guaranteed Approximation Bounds for Mixed-Precision Neural Operators ICLR 2024 InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management OSDI 2024 KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization NeurIPS 2024 Layer-wise Importance Matters: Less Memory for Better Performance in Parameter-efficient Fine-tuning of Large Language Models EMNLP 2024 LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs IJCAI 2024 LLM in a flash: Efficient Large Language Model Inference with Limited Memory ACL 2024 Memorize Step by Step: Efficient Long-Context Prefilling with Incremental Memory and Decremental Chunk EMNLP 2024 Mini-Sequence Transformers: Optimizing Intermediate Memory for Long Sequences Training NeurIPS 2024 NACL: A General and Effective KV Cache Eviction Framework for LLM at Inference Time ACL 2024 Pipeline Parallelism with Controllable Memory NeurIPS 2024 PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference ACL 2024 Reducing Transformer Key-Value Cache Size with Cross-Layer Attention NeurIPS 2024 Rethinking Memory and Communication Costs for Efficient Data Parallel Training of Large Language Models NeurIPS 2024 SpeedLoader: An I/O efficient scheme for heterogeneous and distributed LLM operation NeurIPS 2024 SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget ACL 2024 Thinking Forward: Memory-Efficient Federated Finetuning of Language Models NeurIPS 2024 Accelerated On-Device Forward Neural Network Training with Module-Wise Descending Asynchronism NeurIPS 2023 A fast heuristic to optimize time-space tradeoff for large models NeurIPS 2023 A Survey on Efficient Training of Transformers IJCAI 2023