← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

UDC: Unified DNAS for Compressible TinyML Models for Neural Processing Units NIPS 2022
Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations NIPS 2022
Outsourcing Training without Uploading Data via Efficient Collaborative Open-Source Sampling NIPS 2022
On-Device Training Under 256KB Memory NIPS 2022
Deep Model Reassembly NIPS 2022
TREC: Transient Redundancy Elimination-based Convolution NIPS 2022
Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropagation NIPS 2022
Accelerating Sparse Convolution with Column Vector-Wise Sparsity NIPS 2022
Teach Less, Learn More: On the Undistillable Classes in Knowledge Distillation NIPS 2022
Pruning Neural Networks via Coresets and Convex Geometry: Towards No Assumptions NIPS 2022
VTC-LFC: Vision Transformer Compression with Low-Frequency Components NIPS 2022
Towards Efficient 3D Object Detection with Knowledge Distillation NIPS 2022
Entropy-Driven Mixed-Precision Quantization for Deep Network Design NIPS 2022
The trade-offs of model size in large recommendation models : 100GB to 10MB Criteo-tb DLRM model NIPS 2022
SInGE: Sparsity via Integrated Gradients Estimation of Neuron Relevance NIPS 2022
M³ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design NIPS 2022
Structural Pruning via Latency-Saliency Knapsack NIPS 2022
Q-ViT: Accurate and Fully Quantized Low-bit Vision Transformer NIPS 2022
Not All Bits have Equal Value: Heterogeneous Precisions via Trainable Noise NIPS 2022
Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning NIPS 2022
Meta-Learning Adaptive Knowledge Distillation for Efficient Biomedical Natural Language Processing AACL 2022
Towards Simple and Efficient Task-Adaptive Pre-training for Text Classification AACL 2022
Learning Disentangled Representation in Pruning for Real-Time UAV Tracking ACML 2022
Performance-Efficiency Trade-Offs in Adapting Language Models to Text Classification Tasks IJCNLP 2022
Low-Cost Multispectral Scene Analysis With Modality Distillation WACV 2022