Model Compression

Rotated Binary Neural Network NeurIPS 2020 RTN: Reparameterized Ternary Network AAAI 2020 Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot NeurIPS 2020 Scalable Model Compression by Entropy Penalized Reparameterization ICLR 2020 Scale down Transformer by Grouping Features for a Lightweight Character-level Language Model COLING 2020 Soft Threshold Ternary Networks IJCAI 2020 Soft Threshold Weight Reparameterization for Learnable Sparsity ICML 2020 Sparse Mixture of Local Experts for Efficient Speech Enhancement Interspeech 2020 Sparsity-Inducing Binarized Neural Networks AAAI 2020 SpikeGrad: An ANN-equivalent Computation Model for Implementing Backpropagation with Spikes ICLR 2020 Squeeze for Sneeze: Compact Neural Networks for Cold and Flu Recognition Interspeech 2020 Structured Compression by Weight Encryption for Unstructured Pruning and Quantization CVPR 2020 Structured Compression of Deep Neural Networks with Debiased Elastic Group LASSO WACV 2020 Structured Multi-Hashing for Model Compression CVPR 2020 Structured Pruning of Large Language Models EMNLP 2020 Successfully Applying the Stabilized Lottery Ticket Hypothesis to the Transformer Architecture ACL 2020 T-Basis: a Compact Representation for Neural Networks ICML 2020 Tensorized Embedding Layers EMNLP 2020 The Knowledge Within: Methods for Data-Free Model Compression CVPR 2020 TinyBERT: Distilling BERT for Natural Language Understanding EMNLP 2020 TinyTL: Reduce Memory, Not Parameters for Efficient On-Device Learning NeurIPS 2020 Towards Efficient Model Compression via Learned Global Ranking CVPR 2020 Towards Fully 8-bit Integer Inference for the Transformer Model IJCAI 2020 Training Binary Neural Networks through Learning with Noisy Supervision ICML 2020 Training binary neural networks with real-to-binary convolutions ICLR 2020