memory optimization

POET: Training Neural Networks on Tiny Devices with Integrated Rematerialization and Paging ICML 2022 Tempo: Accelerating Transformer-Based Model Training through Memory Footprint Reduction NeurIPS 2022 AC-GC: Lossy Activation Compression with Guaranteed Convergence NeurIPS 2021 Efficient Combination of Rematerialization and Offloading for Training DNNs NeurIPS 2021 How far can we get with one GPU in 100 hours? CoAStaL at MultiIndicMT Shared Task ACL 2021 Memory Optimization for Deep Networks ICLR 2021 Multi-split Reversible Transformers Can Enhance Neural Machine Translation EACL 2021 Optimal Gradient Checkpoint Search for Arbitrary Computation Graphs CVPR 2021 Piper: Multidimensional Planner for DNN Parallelization NeurIPS 2021 Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup ACL 2021 Scaling Semantic Segmentation Beyond 1K Classes on a Single GPU ICCV 2021 Boosting Deep Neural Network Efficiency with Dual-Module Inference ICML 2020 MCUNet: Tiny Deep Learning on IoT Devices NeurIPS 2020 MemNAS: Memory-Efficient Neural Architecture Search With Grow-Trim Learning CVPR 2020 RNNs can generate bounded hierarchical languages with optimal memory EMNLP 2020 Stable and expressive recurrent vision models NeurIPS 2020 A Graph Theoretic Framework of Recomputation Algorithms for Memory-Efficient Backpropagation NeurIPS 2019 Compressing Gradient Optimizers via Count-Sketches ICML 2019 Efficient Rematerialization for Deep Networks NeurIPS 2019 Memory-Optimal Direct Convolutions for Maximizing Classification Accuracy in Embedded Applications ICML 2019 In-Place Activated BatchNorm for Memory-Optimized Training of DNNs CVPR 2018 Mixed Precision Training ICLR 2018 The Karlsruhe Institute of Technology Systems for the News Translation Task in WMT 2018 EMNLP 2018 Efficient Use of Limited-Memory Accelerators for Linear Learning on Heterogeneous Systems NeurIPS 2017 Memory-Efficient Backpropagation Through Time NeurIPS 2016