conftrace_

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

Learning Federated Visual Prompt in Null Space for MRI Reconstruction CVPR 2023

Accelerating Vision-Language Pretraining With Free Language Modeling CVPR 2023

Multi-Level Logit Distillation CVPR 2023

Data-Free Knowledge Distillation via Feature Exchange and Activation Region Constraint CVPR 2023

Exploiting Network Compressibility and Topology in Zero-Cost NAS AUTOML 2023

SFT-KD-Recon: Learning a Student-friendly Teacher for Knowledge Distillation in Magnetic Resonance Image Reconstruction MIDL 2023

Compact and Optimal Deep Learning With Recurrent Parameter Generators WACV 2023

TORE: Token Reduction for Efficient Human Mesh Recovery with Transformer ICCV 2023

Detecting and Repairing Deviated Outputs of Compressed Models ACML 2023

Facto-CNN: Memory-Efficient CNN Training with Low-rank Tensor Factorization and Lossy Tensor Compression ACML 2023

Tunable Soft Prompts are Messengers in Federated Learning EMNLP 2023

Breaking through Deterministic Barriers: Randomized Pruning Mask Generation and Selection EMNLP 2023

Multilingual Lottery Tickets to Pretrain Language Models EMNLP 2023

Condensing Multilingual Knowledge with Lightweight Language-Specific Modules EMNLP 2023

Parameter-efficient Tuning for Large Language Model without Calculating Its Gradients EMNLP 2023

Towards a Smaller Student: Capacity Dynamic Distillation for Efficient Image Retrieval CVPR 2023

Efficient Transformer Knowledge Distillation: A Performance Review EMNLP 2023

Quantifying lottery tickets under label noise: accuracy, calibration, and complexity UAI 2023

DisCo: Distilled Student Models Co-training for Semi-supervised Text Mining EMNLP 2023

Adapting Language Models to Compress Contexts EMNLP 2023

Adaptive Gating in Mixture-of-Experts based Language Models EMNLP 2023

Lion: Adversarial Distillation of Proprietary Large Language Models EMNLP 2023

Task-specific Compression for Multi-task Language Models using Attribution-based Pruning EACL 2023

Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective EACL 2023

KD-Zero: Evolving Knowledge Distiller for Any Teacher-Student Pairs NIPS 2023