← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

NeuroPrune: A Neuro-inspired Topological Sparse Training Algorithm for Large Language Models ACL 2024
Distilling Robustness into Natural Language Inference Models with Domain-Targeted Augmentation ACL 2024
LoRA Meets Dropout under a Unified Framework ACL 2024
MediSwift: Efficient Sparse Pre-trained Biomedical Language Models ACL 2024
AFPQ: Asymmetric Floating Point Quantization for LLMs ACL 2024
AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models ACL 2024
UltraSparseBERT: 99% Conditionally Sparse Language Modelling ACL 2024
Emulated Disalignment: Safety Alignment for Large Language Models May Backfire! ACL 2024
Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding ACL 2024
BitsFusion: 1.99 bits Weight Quantization of Diffusion Model NIPS 2024
Even Sparser Graph Transformers NIPS 2024
Reasons and Solutions for the Decline in Model Performance after Editing NIPS 2024
VkD: Improving Knowledge Distillation using Orthogonal Projections CVPR 2024
Asymmetric Masked Distillation for Pre-Training Small Foundation Models CVPR 2024
Towards Accurate Post-training Quantization for Diffusion Models CVPR 2024
Instance-Aware Group Quantization for Vision Transformers CVPR 2024
LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding ACL 2024
DB-LLM: Accurate Dual-Binarization for Efficient LLMs ACL 2024
ResLoRA: Identity Residual Mapping in Low-Rank Adaption ACL 2024
AS-ES Learning: Towards efficient CoT learning in small models ACL 2024
Finding Lottery Tickets in Vision Models via Data-driven Spectral Foresight Pruning CVPR 2024
A Comprehensive Evaluation of Quantization Strategies for Large Language Models ACL 2024
Differentially Private Knowledge Distillation via Synthetic Text Generation ACL 2024
Sparsity-Accelerated Training for Large Language Models ACL 2024
Compact Speech Translation Models via Discrete Speech Units Pretraining ACL 2024