model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anything CVPR 2024

SHViT: Single-Head Vision Transformer with Memory Efficient Macro Design CVPR 2024

On the Impact of Calibration Data in Post-training Quantization and Pruning ACL 2024

Tuning Stable Rank Shrinkage: Aiming at the Overlooked Structural Risk in Fine-tuning CVPR 2024

Efficient Low-Dimensional Compression of Overparameterized Models AISTATS 2024

Acquiring Clean Language Models from Backdoor Poisoned Datasets by Downscaling Frequency Space ACL 2024

ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization NIPS 2024

Zero-TPrune: Zero-Shot Token Pruning through Leveraging of the Attention Graph in Pre-Trained Transformers CVPR 2024

Fixed Point Diffusion Models CVPR 2024

UltraSparseBERT: 99% Conditionally Sparse Language Modelling ACL 2024

MediSwift: Efficient Sparse Pre-trained Biomedical Language Models ACL 2024

CQIL: Inference Latency Optimization with Concurrent Computation of Quasi-Independent Layers ACL 2024

Adaptive Compression in Federated Learning via Side Information AISTATS 2024

SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget ACL 2024

White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is? JMLR 2024

WRP: Weight Recover Prune for Structured Sparsity ACL 2024

Surgical Feature-Space Decomposition of LLMs: Why, When and How? ACL 2024

AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models NIPS 2024

TueCICL at SemEval-2024 Task 8: Resource-efficient approaches for machine-generated text detection SEMEVAL 2024

Traceable Federated Continual Learning CVPR 2024

BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation ACL 2024

byteLLM@LT-EDI-2024: Homophobia/Transphobia Detection in Social Media Comments - Custom Subword Tokenization with Subword2Vec and BiLSTM EACL 2024

Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference EACL 2024

Knowledge Transfer via Compact Model in Federated Learning (Student Abstract) AAAI 2024

Find the Lady: Permutation and Re-synchronization of Deep Neural Networks AAAI 2024