Model Compression

ESL-SNNs: An Evolutionary Structure Learning Strategy for Spiking Neural Networks AAAI 2023 Estimator Meets Equilibrium Perspective: A Rectified Straight Through Estimator for Binary Neural Networks Training ICCV 2023 Exploring All-In-One Knowledge Distillation Framework for Neural Machine Translation EMNLP 2023 Exploring the Relative Value of Collaborative Optimisation Pathways (Student Abstract) AAAI 2023 Exploring Transformers as Compact, Data-efficient Language Models CoNLL 2023 FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformer AAAI 2023 Facto-CNN: Memory-Efficient CNN Training with Low-rank Tensor Factorization and Lossy Tensor Compression ACML 2023 Fair Scratch Tickets: Finding Fair Sparse Networks Without Weight Training CVPR 2023 Fast and Accurate Binary Neural Networks Based on Depth-Width Reshaping AAAI 2023 Fast as CHITA: Neural Network Pruning with Combinatorial Optimization ICML 2023 Finding the Pillars of Strength for Multi-Head Attention ACL 2023 Fine-tuning Audio Spectrogram Transformer with Task-aware Adapters for Sound Event Detection Interspeech 2023 FIT: A Metric for Model Sensitivity ICLR 2023 Fixed Input Parameterization for Efficient Prompting ACL 2023 From Knowledge Distillation to Self-Knowledge Distillation: A Unified Approach with Normalized Loss and Customized Soft Labels ICCV 2023 garNER at SemEval-2023: Simplified Knowledge Augmentation for Multilingual Complex Named Entity Recognition SemEval 2023 GEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decoding ACL 2023 GNNDelete: A General Strategy for Unlearning in Graph Neural Networks ICLR 2023 GOHSP: A Unified Framework of Graph and Optimization-Based Heterogeneous Structured Pruning for Vision Transformer AAAI 2023 GPT4All: An Ecosystem of Open Source Compressed Language Models EMNLP 2023 GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints EMNLP 2023 Gradient-based Intra-attention Pruning on Pre-trained Language Models ACL 2023 Gradient-Free Structured Pruning with Unlabeled Data ICML 2023 Graph Structure Learning via Lottery Hypothesis at Scale ACML 2023 GWQ: Group-Wise Quantization Framework for Neural Networks ACML 2023