conftrace_
← Keywords

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation NIPS 2023
A fast heuristic to optimize time-space tradeoff for large models NIPS 2023
Fair Scratch Tickets: Finding Fair Sparse Networks Without Weight Training CVPR 2023
Learning Re-sampling Methods with Parameter Attribution for Image Super-resolution NIPS 2023
Dynamic Inference With Grounding Based Vision and Language Models CVPR 2023
Understanding Neural Network Binarization with Forward and Backward Proximal Quantizers NIPS 2023
You Only Condense Once: Two Rules for Pruning Condensed Datasets NIPS 2023
ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer NIPS 2023
Every Parameter Matters: Ensuring the Convergence of Federated Learning with Dynamic Heterogeneous Models Reduction NIPS 2023
Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets NIPS 2023
No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models NIPS 2023
Learning Large Graph Property Prediction via Graph Segment Training NIPS 2023
PDP: Parameter-free Differentiable Pruning is All You Need NIPS 2023
Towards Efficient Pre-Trained Language Model via Feature Correlation Distillation NIPS 2023
What Knowledge Gets Distilled in Knowledge Distillation? NIPS 2023
One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation NIPS 2023
Slimmed Asymmetrical Contrastive Learning and Cross Distillation for Lightweight Model Training NIPS 2023
Revisit the Power of Vanilla Knowledge Distillation: from Small Scale to Large Scale NIPS 2023
REx: Data-Free Residual Quantization Error Expansion NIPS 2023
Token-Scaled Logit Distillation for Ternary Weight Generative Language Models NIPS 2023
One Less Reason for Filter Pruning: Gaining Free Adversarial Robustness with Structured Grouped Kernel Pruning NIPS 2023
Dynamic Sparsity Is Channel-Level Sparsity Learner NIPS 2023
Teacher Assistant-Based Knowledge Distillation Extracting Multi-level Features on Single Channel Sleep EEG IJCAI 2023
Channel Regeneration: Improving Channel Utilization for Compact DNNs AAAI 2023
Memory-Oriented Structural Pruning for Efficient Image Restoration AAAI 2023