conftrace_

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

Continual Knowledge Distillation for Neural Machine Translation ACL 2023

ABC-KD: Attention-Based-Compression Knowledge Distillation for Deep Learning-Based Noise Suppression INTERSPEECH 2023

Fast as CHITA: Neural Network Pruning with Combinatorial Optimization ICML 2023

DoCoFL: Downlink Compression for Cross-Device Federated Learning ICML 2023

Structured Pruning for Efficient Generative Pre-trained Language Models ACL 2023

Instant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models ICML 2023

Practical Network Acceleration With Tiny Sets CVPR 2023

UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers ICML 2023

NoisyQuant: Noisy Bias-Enhanced Post-Training Activation Quantization for Vision Transformers CVPR 2023

MUX-PLMs: Pre-training Language Models with Data Multiplexing ACL 2023

PCNN: A Lightweight Parallel Conformer Neural Network for Efficient Monaural Speech Enhancement INTERSPEECH 2023

Recycle-and-Distill: Universal Compression Strategy for Transformer-based Speech SSL Models with Attention Map Reusing and Masking Distillation INTERSPEECH 2023

TexQ: Zero-shot Network Quantization with Texture Feature Distribution Calibration NIPS 2023

INGENIOUS: Using Informative Data Subsets for Efficient Pre-Training of Language Models EMNLP 2023

MCC-KD: Multi-CoT Consistent Knowledge Distillation EMNLP 2023

Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefix EMNLP 2023

DistillCSE: Distilled Contrastive Learning for Sentence Embeddings EMNLP 2023

Retrieval-based Knowledge Transfer: An Effective Approach for Extreme Large Language Model Compression EMNLP 2023

Decomposed Prompt Tuning via Low-Rank Reparameterization EMNLP 2023

MSCFFN: A New FFN with Multi-Space Cross to Accelerate Transformer EMNLP 2023

Evaluating Parameter-Efficient Finetuning Approaches for Pre-trained Models on the Financial Domain EMNLP 2023

Itri Amigos at ArAIEval Shared Task: Transformer vs. Compression-Based Models for Persuasion Techniques and Disinformation Detection EMNLP 2023

Automated Knowledge Distillation via Monte Carlo Tree Search ICCV 2023

Lifting the Curse of Capacity Gap in Distilling Language Models ACL 2023

CSTAR: Towards Compact and Structured Deep Neural Networks with Adversarial Robustness AAAI 2023