← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

PENNI: Pruned Kernel Sharing for Efficient CNN Inference ICML 2020
Divide and Conquer: Leveraging Intermediate Feature Representations for Quantized Training of Neural Networks ICML 2020
Towards Accurate Post-training Network Quantization via Bit-Split and Stitching ICML 2020
PoWER-BERT: Accelerating BERT Inference via Progressive Word-vector Elimination ICML 2020
Train Big, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers ICML 2020
A Natural Lottery Ticket Winner: Reinforcement Learning with Ordinary Neural Circuits ICML 2020
The Tree Ensemble Layer: Differentiability meets Conditional Computation ICML 2020
Finding trainable sparse networks through Neural Tangent Transfer ICML 2020
Multiclass Neural Network Minimization via Tropical Newton Polytope Approximation ICML 2020
The k-tied Normal Distribution: A Compact Parameterization of Gaussian Mean Field Posteriors in Bayesian Neural Networks ICML 2020
Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection ICML 2020
Once-for-All Adversarial Training: In-Situ Tradeoff between Robustness and Accuracy for Free NIPS 2020
Born-Again Tree Ensembles ICML 2020
FastFormers: Highly Efficient Transformer Models for Natural Language Understanding EMNLP 2020
SqueezeBERT: What can computer vision teach NLP about efficient neural networks? EMNLP 2020
Early Exiting BERT for Efficient Document Ranking EMNLP 2020
Assessment of DistilBERT performance on Named Entity Recognition task for the detection of Protected Health Information and medical concepts EMNLP 2020
Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP EMNLP 2020
Vector-Vector-Matrix Architecture: A Novel Hardware-Aware Framework for Low-Latency Inference in NLP Applications EMNLP 2020
CP-NAS: Child-Parent Neural Architecture Search for 1-bit CNNs IJCAI 2020
Direct Quantization for Training Highly Accurate Low Bit-width Deep Neural Networks IJCAI 2020
Feature Statistics Guided Efficient Filter Pruning IJCAI 2020
Knowledge Distillation from Internal Representations AAAI 2020
Online Knowledge Distillation with Diverse Peers AAAI 2020
InstaNAS: Instance-Aware Neural Architecture Search AAAI 2020