model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

LLM-Pruner: On the Structural Pruning of Large Language Models NIPS 2023

Token-Scaled Logit Distillation for Ternary Weight Generative Language Models NIPS 2023

REx: Data-Free Residual Quantization Error Expansion NIPS 2023

Detecting and Repairing Deviated Outputs of Compressed Models ACML 2023

Binary and Ternary Natural Language Generation ACL 2023

A Gradient Control Method for Backdoor Attacks on Parameter-Efficient Tuning ACL 2023

One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning ACL 2023

DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models ACL 2023

HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation ACL 2023

LAIT: Efficient Multi-Segment Encoding in Transformers with Layer-Adjustable Interaction ACL 2023

f-Divergence Minimization for Sequence-Level Knowledge Distillation ACL 2023

CITADEL: Conditional Token Interaction via Dynamic Lexical Routing for Efficient and Effective Multi-Vector Retrieval ACL 2023

PuMer: Pruning and Merging Tokens for Efficient Vision Language Models ACL 2023

PAD-Net: An Efficient Framework for Dynamic Networks ACL 2023

Mini-Model Adaptation: Efficiently Extending Pretrained Models to New Languages via Aligned Shallow Training ACL 2023

GhostRNN: Reducing State Redundancy in RNN with Cheap Operations INTERSPEECH 2023

Revisit the Power of Vanilla Knowledge Distillation: from Small Scale to Large Scale NIPS 2023

Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models NIPS 2023

Slimmed Asymmetrical Contrastive Learning and Cross Distillation for Lightweight Model Training NIPS 2023

Data-free Knowledge Distillation for Fine-grained Visual Categorization ICCV 2023

INSTA-BNN: Binary Neural Network with INSTAnce-aware Threshold ICCV 2023

Causal-DFQ: Causality Guided Data-Free Network Quantization ICCV 2023

One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation NIPS 2023

Intriguing Properties of Quantization at Scale NIPS 2023

Memory-Efficient Fine-Tuning of Compressed Large Language Models via sub-4-bit Integer Quantization NIPS 2023