← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Slow Learning and Fast Inference: Efficient Graph Similarity Computation via Knowledge Distillation NIPS 2021
Efficient Neural Network Training via Forward and Backward Propagation Sparsification NIPS 2021
Deformable Butterfly: A Highly Structured and Sparse Linear Transform NIPS 2021
Only Train Once: A One-Shot Neural Network Training And Pruning Framework NIPS 2021
Formalizing Generalization and Adversarial Robustness of Neural Networks to Weight Perturbations NIPS 2021
RED : Looking for Redundancies for Data-FreeStructured Compression of Deep Neural Networks NIPS 2021
Stateful ODE-Nets using Basis Function Expansions NIPS 2021
The Flip Side of the Reweighted Coin: Duality of Adaptive Dropout and Regularization NIPS 2021
CHIP: CHannel Independence-based Pruning for Compact Neural Networks NIPS 2021
Unsupervised Representation Transfer for Small Networks: I Believe I Can Distill On-the-Fly NIPS 2021
Learning Frequency Domain Approximation for Binary Neural Networks NIPS 2021
Revisiting Pretraining with Adapters ACL 2021
Direction is what you need: Improving Word Embedding Compression in Large Language Models ACL 2021
Anycost GANs for Interactive Image Synthesis and Editing CVPR 2021
Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation CVPR 2021
How Does Topology Influence Gradient Propagation and Model Performance of Deep Networks With DenseNet-Type Skip Connections? CVPR 2021
Rethinking Channel Dimensions for Efficient Model Design CVPR 2021
Compatibility-Aware Heterogeneous Visual Search CVPR 2021
LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search CVPR 2021
Dynamic Domain Adaptation for Efficient Inference CVPR 2021
Virtual Fully-Connected Layer: Training a Large-Scale Face Recognition Dataset With Limited Computational Resources CVPR 2021
Layer-Wise Searching for 1-Bit Detectors CVPR 2021
Slimmable Compressive Autoencoders for Practical Neural Image Compression CVPR 2021
Diverse Branch Block: Building a Convolution as an Inception-Like Unit CVPR 2021
ClassSR: A General Framework to Accelerate Super-Resolution Networks by Data Characteristic CVPR 2021