← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Pre-RMSNorm and Pre-CRMSNorm Transformers: Equivalent and Efficient Pre-LN Transformers NIPS 2023
Binarized Neural Machine Translation NIPS 2023
Lifelong Compression Mixture Model via Knowledge Relationship Graph AAAI 2023
Pruning vs Quantization: Which is Better? NIPS 2023
Probabilistic Weight Fixing: Large-scale training of neural network weight uncertainties for quantisation. NIPS 2023
SUBP: Soft Uniform Block Pruning for 1$\times$N Sparse CNNs Multithreading Acceleration NIPS 2023
Accelerating Molecular Graph Neural Networks via Knowledge Distillation NIPS 2023
Structural Pruning for Diffusion Models NIPS 2023
Efficient Low-rank Backpropagation for Vision Transformer Adaptation NIPS 2023
Towards High-Quality and Efficient Video Super-Resolution via Spatial-Temporal Data Overfitting CVPR 2023
TinyMIM: An Empirical Study of Distilling MIM Pre-Trained Models CVPR 2023
Boost Vision Transformer With GPU-Friendly Sparsity and Quantization CVPR 2023
Towards a Smaller Student: Capacity Dynamic Distillation for Efficient Image Retrieval CVPR 2023
Toward Accurate Post-Training Quantization for Image Super Resolution CVPR 2023
Structured Sparsity Learning for Efficient Video Super-Resolution CVPR 2023
On the Effectiveness of Parameter-Efficient Fine-Tuning AAAI 2023
What Knowledge Gets Distilled in Knowledge Distillation? NIPS 2023
Towards Efficient Pre-Trained Language Model via Feature Correlation Distillation NIPS 2023
PDP: Parameter-free Differentiable Pruning is All You Need NIPS 2023
Module-wise Adaptive Distillation for Multimodality Foundation Models NIPS 2023
KD-Zero: Evolving Knowledge Distiller for Any Teacher-Student Pairs NIPS 2023
RD-Suite: A Benchmark for Ranking Distillation NIPS 2023
Learning Large Graph Property Prediction via Graph Segment Training NIPS 2023
No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models NIPS 2023
Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets NIPS 2023