← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

NASH: A Simple Unified Framework of Structured Pruning for Accelerating Encoder-Decoder Language Models EMNLP 2023
NarrowBERT: Accelerating Masked Language Model Pretraining and Inference ACL 2023
How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives ACL 2023
HadSkip: Homotopic and Adaptive Layer Skipping of Pre-trained Language Models for Efficient Inference EMNLP 2023
Length-Adaptive Distillation: Customizing Small Language Model for Dynamic Token Pruning EMNLP 2023
Acceleration of Large Transformer Model Training by Sensitivity-Based Layer Dropping AAAI 2023
Boosted Dynamic Neural Networks AAAI 2023
Steganography of Steganographic Networks AAAI 2023
Adaptive Low-Precision Training for Embeddings in Click-Through Rate Prediction AAAI 2023
Towards Fully Quantized Neural Networks For Speech Enhancement INTERSPEECH 2023
Pixel-Wise Contrastive Distillation ICCV 2023
GNN&GBDT-Guided Fast Optimizing Framework for Large-scale Integer Programming ICML 2023
Do You Remember? Overcoming Catastrophic Forgetting for Fake Audio Detection ICML 2023
Rockmate: an Efficient, Fast, Automatic and Generic Tool for Re-materialization in PyTorch ICML 2023
Models Teaching Models: Improving Model Accuracy with Slingshot Learning EACL 2023
Task-Agnostic Structured Pruning of Speech Representation Models INTERSPEECH 2023
Cascaded Multi-task Adaptive Learning Based on Neural Architecture Search INTERSPEECH 2023
Distilling knowledge from Gaussian process teacher to neural network student INTERSPEECH 2023
Model Compression for DNN-based Speaker Verification Using Weight Quantization INTERSPEECH 2023
Lossy and Lossless (L2) Post-training Model Size Compression ICCV 2023
DenseShift: Towards Accurate and Efficient Low-Bit Power-of-Two Quantization ICCV 2023
Carburacy: Summarization Models Tuning and Comparison in Eco-Sustainable Regimes with a Novel Carbon-Aware Accuracy AAAI 2023
Exploring the Relative Value of Collaborative Optimisation Pathways (Student Abstract) AAAI 2023
Compressing Transformers: Features Are Low-Rank, but Weights Are Not! AAAI 2023
Ultra Dual-Path Compression For Joint Echo Cancellation And Noise Suppression INTERSPEECH 2023