memory optimization

Coop: Memory is not a Commodity NeurIPS 2023 Differentially Private Optimization on Large Model at Small Cost ICML 2023 DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training ICLR 2023 Dynamic Stashing Quantization for Efficient Transformer Training EMNLP 2023 Efficient Beam Tree Recursion NeurIPS 2023 FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU ICML 2023 H3T: Efficient Integration of Memory Optimization and Parallelism for Large-scale Transformer Training NeurIPS 2023 MCUFormer: Deploying Vision Tranformers on Microcontrollers with Limited Memory NeurIPS 2023 Moccasin: Efficient Tensor Rematerialization for Neural Networks ICML 2023 MODeL: Memory Optimizations for Deep Learning ICML 2023 OSDP: Optimal Sharded Data Parallel for Distributed Deep Learning IJCAI 2023 Rockmate: an Efficient, Fast, Automatic and Generic Tool for Re-materialization in PyTorch ICML 2023 Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Time NeurIPS 2023 SMART: A High-Performance Adaptive Radix Tree for Disaggregated Memory OSDI 2023 Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks ICCV 2023 UPSCALE: Unconstrained Channel Pruning ICML 2023 A*+BFHS: A Hybrid Heuristic Search Algorithm AAAI 2022 An In-depth Study of Stochastic Backpropagation NeurIPS 2022 Be Like Water: Adaptive Floating Point for Machine Learning ICML 2022 BMInf: An Efficient Toolkit for Big Model Inference and Tuning ACL 2022 Deep Equilibrium Optical Flow Estimation CVPR 2022 GACT: Activation Compressed Training for Generic Network Architectures ICML 2022 Graph Reordering for Cache-Efficient Near Neighbor Search NeurIPS 2022 How Low Can We Go: Trading Memory for Error in Low-Precision Training ICLR 2022 Memory-Efficient Training of RNN-Transducer with Sampled Softmax Interspeech 2022