← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

SOI: Scaling Down Computational Complexity by Estimating Partial States of the Model NIPS 2024
Finding Lottery Tickets in Vision Models via Data-driven Spectral Foresight Pruning CVPR 2024
FLORA: Fine-Grained Low-Rank Architecture Search for Vision Transformer WACV 2024
ConsistentEE: A Consistent and Hardness-Guided Early Exiting Method for Accelerating Language Models Inference AAAI 2024
FAKD: Feature Augmented Knowledge Distillation for Semantic Segmentation WACV 2024
Find the Lady: Permutation and Re-synchronization of Deep Neural Networks AAAI 2024
On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion NIPS 2024
Instance-Aware Group Quantization for Vision Transformers CVPR 2024
Towards Accurate Post-training Quantization for Diffusion Models CVPR 2024
Asymmetric Masked Distillation for Pre-Training Small Foundation Models CVPR 2024
DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing AAAI 2024
Layer Attack Unlearning: Fast and Accurate Machine Unlearning via Layer Level Attack and Knowledge Distillation AAAI 2024
VkD: Improving Knowledge Distillation using Orthogonal Projections CVPR 2024
Transformer as Linear Expansion of Learngene AAAI 2024
MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts AAAI 2024
BVT-IMA: Binary Vision Transformer with Information-Modified Attention AAAI 2024
VMT-Adapter: Parameter-Efficient Transfer Learning for Multi-Task Dense Scene Understanding AAAI 2024
DSD²: Can We Dodge Sparse Double Descent and Compress the Neural Network Worry-Free? AAAI 2024
FALCON: FLOP-Aware Combinatorial Optimization for Neural Network Pruning AISTATS 2024
Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation AAAI 2024
Minimal Distillation Schedule for Extreme Language Model Compression EACL 2024
Reinforcement Learning as a Parsimonious Alternative to Prediction Cascades: A Case Study on Image Segmentation AAAI 2024
Leveraging Normalization Layer in Adapters with Progressive Learning and Adaptive Distillation for Cross-Domain Few-Shot Learning AAAI 2024
Small Scale Data-Free Knowledge Distillation CVPR 2024
All Rivers Run to the Sea: Private Learning with Asymmetric Flows CVPR 2024