conftrace_
← Keywords

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

ORC: Network Group-based Knowledge Distillation using Online Role Change ICCV 2023
Can We Find Strong Lottery Tickets in Generative Models? AAAI 2023
EELBERT: Tiny Models through Dynamic Embeddings EMNLP 2023
Multi-teacher Distillation for Multilingual Spelling Correction EMNLP 2023
Towards Higher Ranks via Adversarial Weight Pruning NIPS 2023
Multiplication-Free Transformer Training via Piecewise Affine Operations NIPS 2023
A Comparative Analysis of Task-Agnostic Distillation Methods for Compressing Transformer Language Models EMNLP 2023
Are Compressed Language Models Less Subgroup Robust? EMNLP 2023
Enhancing Computation Efficiency in Large Language Models through Weight and Activation Quantization EMNLP 2023
A Frustratingly Easy Post-Training Quantization Scheme for LLMs EMNLP 2023
Text Representation Distillation via Information Bottleneck Principle EMNLP 2023
The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Matter NIPS 2023
DIME-FM : DIstilling Multimodal and Efficient Foundation Models ICCV 2023
IMF: Integrating Matched Features Using Attentive Logit in Knowledge Distillation IJCAI 2023
Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference NIPS 2023
Progressive Ensemble Distillation: Building Ensembles for Efficient Inference NIPS 2023
SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models UAI 2023
BiMatting: Efficient Video Matting via Binarization NIPS 2023
MixFormerV2: Efficient Fully Transformer Tracking NIPS 2023
Distilling from Similar Tasks for Transfer Learning on a Budget ICCV 2023
Greedy Pruning with Group Lasso Provably Generalizes for Matrix Sensing NIPS 2023
Knowledge Distillation Performs Partial Variance Reduction NIPS 2023
Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference? EMNLP 2023
Mem-Rec: Memory Efficient Recommendation System using Alternative Representation ACML 2023
Efficient Training of Large-Scale Industrial Fault Diagnostic Models through Federated Opportunistic Block Dropout AAAI 2023