← Application Areas
Machine Learning › Application Areas ›

Model Compression

1503 directly classified papers

Papers per year

Papers

On Distillation of Guided Diffusion Models CVPR 2023
Moccasin: Efficient Tensor Rematerialization for Neural Networks ICML 2023
Fast as CHITA: Neural Network Pruning with Combinatorial Optimization ICML 2023
Efficient Latency-Aware CNN Depth Compression via Two-Stage Dynamic Programming ICML 2023
LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation ICML 2023
Less is More: Task-aware Layer-wise Distillation for Language Model Compression ICML 2023
Dataset Distillation with Convexified Implicit Gradients ICML 2023
STEP: Learning N:M Structured Sparsity Masks from Scratch with Precondition ICML 2023
Task-Specific Skill Localization in Fine-tuned Language Models ICML 2023
BiBench: Benchmarking and Analyzing Network Binarization ICML 2023
Discrete Key-Value Bottleneck ICML 2023
UPSCALE: Unconstrained Channel Pruning ICML 2023
Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases ICML 2023
COLA: Orchestrating Error Coding and Learning for Robust Neural Network Inference Against Hardware Defects ICML 2023
Bi-directional Masks for Efficient N:M Sparse Training ICML 2023
Rockmate: an Efficient, Fast, Automatic and Generic Tool for Re-materialization in PyTorch ICML 2023
spred: Solving L1 Penalty with SGD ICML 2023
TexQ: Zero-shot Network Quantization with Texture Feature Distribution Calibration NIPS 2023
Leveraging Inter-Layer Dependency for Post -Training Quantization NIPS 2022
Resource-Adaptive Federated Learning with All-In-One Neural Composition NIPS 2022
Knowledge Inheritance for Pre-trained Language Models NAACL 2022
RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation NAACL 2022
Winning the Lottery Ahead of Time: Efficient Early Network Pruning ICML 2022
Communication-efficient Distributed Learning for Large Batch Optimization ICML 2022
TSPipe: Learn from Teacher Faster with Pipelines ICML 2022