Model Compression

Transferable Post-hoc Calibration on Pretrained Transformers in Noisy Text Classification AAAI 2023 Trapdoor Normalization with Irreversible Ownership Verification ICML 2023 TVSPrune - Pruning Non-discriminative filters via Total Variation separability of intermediate representations without fine tuning ICLR 2023 UMUTeam at SemEval-2023 Task 12: Ensemble Learning of LLMs applied to Sentiment Analysis for Low-resource African Languages SemEval 2023 Understand and Modularize Generator Optimization in ELECTRA-style Pretraining ICML 2023 Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases ICML 2023 Unified Low-Resource Sequence Labeling by Sample-Aware Dynamic Sparse Finetuning EMNLP 2023 Unlearn What You Want to Forget: Efficient Unlearning for LLMs EMNLP 2023 Unmasking the Lottery Ticket Hypothesis: What's Encoded in a Winning Ticket's Mask? ICLR 2023 UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers ICML 2023 UPSCALE: Unconstrained Channel Pruning ICML 2023 VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control ICCV 2023 What Makes Convolutional Models Great on Long Sequence Modeling? ICLR 2023 Your representations are in the network: composable and parallel adaptation for large scale models NeurIPS 2023 Zero-shot Sharpness-Aware Quantization for Pre-trained Language Models EMNLP 2023 ZipLM: Inference-Aware Structured Pruning of Language Models NeurIPS 2023 Accelerating Inference and Language Model Fusion of Recurrent Neural Network Transducers via End-to-End 4-bit Quantization Interspeech 2022 Accelerating Sparse Convolution with Column Vector-Wise Sparsity NeurIPS 2022 AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning EMNLP 2022 AdapLeR: Speeding up Inference by Adaptive Length Reduction ACL 2022 AdapterBias: Parameter-efficient Token-dependent Representation Shift for Adapters in NLP Tasks NAACL 2022 AdapterShare: Task Correlation Modeling with Adapter Differentiation EMNLP 2022 Adapting a Language Model While Preserving its General Knowledge EMNLP 2022 AdaSTE: An Adaptive Straight-Through Estimator To Train Binary Neural Networks CVPR 2022 A Flexible Multi-Task Model for BERT Serving ACL 2022