conftrace_
← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Iterative Soft Shrinkage Learning for Efficient Image Super-Resolution ICCV 2023
HollowNeRF: Pruning Hashgrid-Based NeRFs with Trainable Collision Mitigation ICCV 2023
YANMTT: Yet Another Neural Machine Translation Toolkit ACL 2023
Towards Understanding Ensemble Distillation in Federated Learning ICML 2023
SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient ICML 2023
ScaleKD: Distilling Scale-Aware Knowledge in Small Object Detector CVPR 2023
Shapley Head Pruning: Identifying and Removing Interference in Multilingual Transformers EACL 2023
GOHSP: A Unified Framework of Graph and Optimization-Based Heterogeneous Structured Pruning for Vision Transformer AAAI 2023
SPIQ: Data-Free Per-Channel Static Input Quantization WACV 2023
Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization ACL 2023
Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers EACL 2023
TinyHD: Efficient Video Saliency Prediction With Heterogeneous Decoders Using Hierarchical Maps Distillation WACV 2023
EfficientViT: Memory Efficient Vision Transformer With Cascaded Group Attention CVPR 2023
Gradient-based Intra-attention Pruning on Pre-trained Language Models ACL 2023
BADGE: Speeding Up BERT Inference after Deployment via Block-wise Bypasses and Divergence-based Early Exiting ACL 2023
UPSCALE: Unconstrained Channel Pruning ICML 2023
Quantifying the Knowledge in GNNs for Reliable Distillation into MLPs ICML 2023
SLAMB: Accelerated Large Batch Training with Sparse Communication ICML 2023
Symbolic Chain-of-Thought Distillation: Small Models Can Also “Think” Step-by-Step ACL 2023
LEALLA: Learning Lightweight Language-agnostic Sentence Embeddings with Knowledge Distillation EACL 2023
Re2TAL: Rewiring Pretrained Video Backbones for Reversible Temporal Action Localization CVPR 2023
Enhancing Abstractiveness of Summarization Models through Calibrated Distillation EMNLP 2023
Distill or Annotate? Cost-Efficient Fine-Tuning of Compact Models ACL 2023
FLOAT: Fast Learnable Once-for-All Adversarial Training for Tunable Trade-Off Between Accuracy and Robustness WACV 2023
The Cost of Compression: Investigating the Impact of Compression on Parametric Knowledge in Language Models EMNLP 2023