← Core AI
Artificial Intelligence › Core AI ›

Model Compression

1928 directly classified papers

Papers per year

Papers

PALBERT: Teaching ALBERT to Ponder NIPS 2022
Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection EMNLP 2022
Accelerating Sparse Convolution with Column Vector-Wise Sparsity NIPS 2022
Efficient Training of Low-Curvature Neural Networks NIPS 2022
Deep Model Reassembly NIPS 2022
On-Device Training Under 256KB Memory NIPS 2022
Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations NIPS 2022
An Information-Theoretic Justification for Model Pruning AISTATS 2022
Can Functional Transfer Methods Capture Simple Inductive Biases? AISTATS 2022
AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models EMNLP 2022
Partially-Random Initialization: A Smoking Gun for Binarization Hypothesis of BERT EMNLP 2022
Quadapter: Adapter for GPT-2 Quantization EMNLP 2022
SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters EMNLP 2022
A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibration ICML 2021
AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models IJCNLP 2021
BERxiT: Early Exiting for BERT with Better Fine-Tuning and Extension to Regression EACL 2021
Extremely Small BERT Models from Mixed-Vocabulary Training EACL 2021
Annealing Knowledge Distillation EACL 2021
Arabic Compact Language Modelling for Resource Limited Devices EACL 2021
On-Device Text Representations Robust To Misspellings via Projections EACL 2021
Through the Looking Glass: Learning to Attribute Synthetic Text Generated by Language Models EACL 2021
UniParma at SemEval-2021 Task 5: Toxic Spans Detection Using CharacterBERT and Bag-of-Words Model SEMEVAL 2021
Structured sparsification with joint optimization of group convolution and channel shuffle UAI 2021
Greedy Search Algorithm for Mixed Precision in Post-Training Quantization of Convolutional Neural Network Inspired by Submodular Optimization ACML 2021
DPOQ: Dynamic Precision Onion Quantization ACML 2021