← Optimization & Theory
Deep Learning › Optimization & Theory ›

Model Compression

1674 directly classified papers

Papers per year

Papers

Entropy Induced Pruning Framework for Convolutional Neural Networks AAAI 2024
Consecutive Batch Model Editing with HooK Layers EMNLP 2024
IRPruneDet: Efficient Infrared Small Target Detection via Wavelet Structure-Regularized Soft Channel Pruning AAAI 2024
LION: Implicit Vision Prompt Tuning AAAI 2024
Shapley Head Pruning: Identifying and Removing Interference in Multilingual Transformers EACL 2023
Effectiveness of Data Augmentation for Parameter Efficient Tuning with Limited Data ACL 2023
MUX-PLMs: Pre-training Language Models with Data Multiplexing ACL 2023
EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning ACL 2023
Structured Pruning for Efficient Generative Pre-trained Language Models ACL 2023
Modular Transformers: Compressing Transformers into Modularized Layers for Flexible Efficient Inference ACL 2023
LightFormer: Light-weight Transformer Using SVD-based Weight Transfer and Parameter Sharing ACL 2023
Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method ACL 2023
Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers EACL 2023
AutoMoE: Heterogeneous Mixture-of-Experts with Adaptive Computation for Efficient Neural Machine Translation ACL 2023
Neural Architecture Search for Parameter-Efficient Fine-tuning of Large Pre-trained Language Models ACL 2023
Distill or Annotate? Cost-Efficient Fine-Tuning of Compact Models ACL 2023
Rehearsal-free Continual Language Learning via Efficient Parameter Isolation ACL 2023
GreenKGC: A Lightweight Knowledge Graph Completion Method ACL 2023
Revisiting Token Dropping Strategy in Efficient BERT Pretraining ACL 2023
Masked Autoencoders Enable Efficient Knowledge Distillers CVPR 2023
1% VS 100%: Parameter-Efficient Low Rank Adapter for Dense Predictions CVPR 2023
X-Pruner: eXplainable Pruning for Vision Transformers CVPR 2023
ScaleKD: Distilling Scale-Aware Knowledge in Small Object Detector CVPR 2023
Effective Ambiguity Attack Against Passport-Based DNN Intellectual Property Protection Schemes Through Fully Connected Layer Substitution CVPR 2023
FLOAT: Fast Learnable Once-for-All Adversarial Training for Tunable Trade-Off Between Accuracy and Robustness WACV 2023