model compression

Are Compressed Language Models Less Subgroup Robust? EMNLP 2023 Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method ACL 2023 Are Large Kernels Better Teachers than Transformers for ConvNets? ICML 2023 Are Straight-Through Gradients and Soft-Thresholding All You Need for Sparse Training? WACV 2023 A Simple and General Binarization Method for Image Restoration Neural Networks ACML 2023 ASkewSGD : An Annealed interval-constrained Optimisation method to train Quantized Neural Networks AISTATS 2023 A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models ACL 2023 A Survey on Model Compression and Acceleration for Pretrained Language Models AAAI 2023 A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training ACL 2023 A Three-regime Model of Network Pruning ICML 2023 Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation NeurIPS 2023 Augmentation with Projection: Towards an Effective and Efficient Data Augmentation Paradigm for Distillation ICLR 2023 A Unified Knowledge Distillation Framework for Deep Directed Graphical Models CVPR 2023 Automated Knowledge Distillation via Monte Carlo Tree Search ICCV 2023 Automatic Attention Pruning: Improving and Automating Model Pruning using Attentions AISTATS 2023 Automatic Network Pruning via Hilbert-Schmidt Independence Criterion Lasso under Information Bottleneck Principle ICCV 2023 AutoReP: Automatic ReLU Replacement for Fast Private Network Inference ICCV 2023 Backdoor Cleansing With Unlabeled Data CVPR 2023 BADGE: Speeding Up BERT Inference after Deployment via Block-wise Bypasses and Divergence-based Early Exiting ACL 2023 Balanced Column-Wise Block Pruning for Maximizing GPU Parallelism AAAI 2023 Basic Binary Convolution Unit for Binarized Image Restoration Network ICLR 2023 Bespoke: A Block-Level Neural Network Optimization Framework for Low-Cost Deployment AAAI 2023 Better Teacher Better Student: Dynamic Prior Knowledge for Knowledge Distillation ICLR 2023 Beyond Attentive Tokens: Incorporating Token Importance and Diversity for Efficient Vision Transformers CVPR 2023 Beyond the Limitation of Monocular 3D Detector via Knowledge Distillation ICCV 2023