conftrace_
← Keywords

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

Information-Theoretic GAN Compression with Variational Energy-based Model NIPS 2022
Get More at Once: Alternating Sparse Training with Gradient Correction NIPS 2022
CryptoGCN: Fast and Scalable Homomorphically Encrypted Graph Convolutional Network Inference NIPS 2022
Exposing and Exploiting Fine-Grained Block Structures for Fast and Accurate Sparse Training NIPS 2022
Controlled Sparsity via Constrained Optimization or: How I Learned to Stop Tuning Penalties and Love Constraints NIPS 2022
"Lossless" Compression of Deep Neural Networks: A High-dimensional Neural Tangent Kernel Approach NIPS 2022
Discovering and Overcoming Limitations of Noise-engineered Data-free Knowledge Distillation NIPS 2022
Weighted Distillation with Unlabeled Examples NIPS 2022
Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation NIPS 2022
On Measuring Excess Capacity in Neural Networks NIPS 2022
Parameter-Efficient Masking Networks NIPS 2022
Weighted Mutual Learning with Diversity-Driven Model Compression NIPS 2022
Deep Compression of Pre-trained Transformer Models NIPS 2022
Rare Gems: Finding Lottery Tickets at Initialization NIPS 2022
FP8 Quantization: The Power of the Exponent NIPS 2022
Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training NIPS 2022
PKD: General Distillation Framework for Object Detectors via Pearson Correlation Coefficient NIPS 2022
AutoMTL: A Programming Framework for Automating Efficient Multi-Task Learning NIPS 2022
Compressible-composable NeRF via Rank-residual Decomposition NIPS 2022
Robust Binary Models by Pruning Randomly-initialized Networks NIPS 2022
Towards Efficient Post-training Quantization of Pre-trained Language Models NIPS 2022
Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models NIPS 2022
Differentially Private Model Compression NIPS 2022
Continuation KD: Improved Knowledge Distillation through the Lens of Continuation Optimization EMNLP 2022
Partially-Random Initialization: A Smoking Gun for Binarization Hypothesis of BERT EMNLP 2022