Model Compression

SDR: Efficient Neural Re-ranking using Succinct Document Representation ACL 2022 Selective compression learning of latent representations for variable-rate image compression NeurIPS 2022 SInGE: Sparsity via Integrated Gradients Estimation of Neuron Relevance NeurIPS 2022 Slimmable Domain Adaptation CVPR 2022 SmartIdx: Reducing Communication Cost in Federated Learning by Exploiting the CNNs Structures AAAI 2022 SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters EMNLP 2022 Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Models NAACL 2022 Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT EMNLP 2022 Sparse Probabilistic Circuits via Pruning and Growing NeurIPS 2022 Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm ACL 2022 Sparse Structure Search for Delta Tuning NeurIPS 2022 Sparse Teachers Can Be Dense with Knowledge EMNLP 2022 Spartan: Differentiable Sparsity via Regularized Transportation NeurIPS 2022 SPDY: Accurate Pruning with Speedup Guarantees ICML 2022 Symbolic Distillation for Learned TCP Congestion Control NeurIPS 2022 Synergy-of-Experts: Collaborate to Improve Adversarial Robustness NeurIPS 2022 Teach Less, Learn More: On the Undistillable Classes in Knowledge Distillation NeurIPS 2022 The Devil is in the Details: On the Pitfalls of Vocabulary Selection in Neural Machine Translation NAACL 2022 The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains EMNLP 2022 The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models EMNLP 2022 The State of Sparse Training in Deep Reinforcement Learning ICML 2022 The trade-offs of model size in large recommendation models : 100GB to 10MB Criteo-tb DLRM model NeurIPS 2022 Tight Neural Network Verification via Semidefinite Relaxations and Linear Reformulations AAAI 2022 To Fold or Not to Fold: a Necessary and Sufficient Condition on Batch-Normalization Layers Folding IJCAI 2022 Token and Head Adaptive Transformers for Efficient Natural Language Processing COLING 2022