conftrace_
← Keywords

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models NIPS 2024
Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models NIPS 2024
Search for Efficient Large Language Models NIPS 2024
LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS NIPS 2024
Uncovering the Redundancy in Graph Self-supervised Learning Models NIPS 2024
The Iterative Optimal Brain Surgeon: Faster Sparse Recovery by Leveraging Second-Order Information NIPS 2024
Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs NIPS 2024
MiniCache: KV Cache Compression in Depth Dimension for Large Language Models NIPS 2024
Teaching Tiny Minds: Exploring Methods to Enhance Knowledge Distillation for Small Language Models CONLL 2024
One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning ACL 2023
DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models ACL 2023
HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation ACL 2023
LAIT: Efficient Multi-Segment Encoding in Transformers with Layer-Adjustable Interaction ACL 2023
f-Divergence Minimization for Sequence-Level Knowledge Distillation ACL 2023
CITADEL: Conditional Token Interaction via Dynamic Lexical Routing for Efficient and Effective Multi-Vector Retrieval ACL 2023
PuMer: Pruning and Merging Tokens for Efficient Vision Language Models ACL 2023
PAD-Net: An Efficient Framework for Dynamic Networks ACL 2023
Mini-Model Adaptation: Efficiently Extending Pretrained Models to New Languages via Aligned Shallow Training ACL 2023
Structural Pruning for Diffusion Models NIPS 2023
Efficient Low-rank Backpropagation for Vision Transformer Adaptation NIPS 2023
Learning Lightweight Neural Networks via Channel-Split Recurrent Convolution WACV 2023
Revisiting Adversarial Robustness Distillation from the Perspective of Robust Fairness NIPS 2023
Intriguing Properties of Quantization at Scale NIPS 2023
Module-wise Adaptive Distillation for Multimodality Foundation Models NIPS 2023
Knowledge Distillation for High Dimensional Search Index NIPS 2023