← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratch CVPR 2024
Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale EMNLP 2024
Context-Aware Assistant Selection for Improved Inference Acceleration with Large Language Models EMNLP 2024
Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference NIPS 2024
Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging EMNLP 2024
Is C4 Dataset Optimal for Pruning? An Investigation of Calibration Data for LLM Pruning EMNLP 2024
Traceable Federated Continual Learning CVPR 2024
Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention EMNLP 2024
Dual-Space Knowledge Distillation for Large Language Models EMNLP 2024
Speedy Gonzales: A Collection of Fast Task-Specific Models for Spanish NAACL 2024
Scaled Decoupled Distillation CVPR 2024
Structured Optimal Brain Pruning for Large Language Models EMNLP 2024
CHESS: Optimizing LLM Inference via Channel-Wise Thresholding and Selective Sparsification EMNLP 2024
The Mamba in the Llama: Distilling and Accelerating Hybrid Models NIPS 2024
Unleashing Channel Potential: Space-Frequency Selection Convolution for SAR Object Detection CVPR 2024
Knowledge boosting during low-latency inference INTERSPEECH 2024
To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillation ACL 2024
Weighted Layer Averaging RoBERTa for Black-Box Machine-Generated Text Detection NAACL 2024
Retaining Key Information under High Compression Ratios: Query-Guided Compressor for LLMs ACL 2024
TueCICL at SemEval-2024 Task 8: Resource-efficient approaches for machine-generated text detection NAACL 2024
White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is? JMLR 2024
Balancing Speciality and Versatility: a Coarse to Fine Framework for Supervised Fine-tuning Large Language Model ACL 2024
ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models EMNLP 2024
NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation CVPR 2024
EPSD: Early Pruning with Self-Distillation for Efficient Model Compression AAAI 2024