conftrace_
← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Operator Selection and Ordering in a Pipeline Approach to Efficiency Optimizations for Transformers ACL 2023
Memory-efficient NLLB-200: Language-specific Expert Pruning of a Massively Multilingual Machine Translation Model ACL 2023
Dynamic and Efficient Inference for Text Generation via BERT Family ACL 2023
Modular and On-demand Bias Mitigation with Attribute-Removal Subnetworks ACL 2023
AccelIR: Task-Aware Image Compression for Accelerating Neural Restoration CVPR 2023
Efficient Multimodal Fusion via Interactive Prompting CVPR 2023
Three Guidelines You Should Know for Universally Slimmable Self-Supervised Learning CVPR 2023
Making Vision Transformers Efficient From a Token Sparsification View CVPR 2023
Train-Once-for-All Personalization CVPR 2023
MDL-NAS: A Joint Multi-Domain Learning Framework for Vision Transformer CVPR 2023
Co-training and Co-distillation for Quality Improvement and Compression of Language Models EMNLP 2023
Segmented Recurrent Transformer: An Efficient Sequence-to-Sequence Model EMNLP 2023
Democratizing LLMs: An Exploration of Cost-Performance Trade-offs in Self-Refined Open-Source Models EMNLP 2023
Dynamic Low-rank Estimation for Transformer-based Language Models EMNLP 2023
Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules EMNLP 2023
Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention EMNLP 2023
SHARCS: Efficient Transformers Through Routing with Dynamic Width Sub-networks EMNLP 2023
Boosting Inference Efficiency: Unleashing the Power of Parameter-Shared Pre-trained Language Models EMNLP 2023
Learn From One Specialized Sub-Teacher: One-to-One Mapping for Feature-Based Knowledge Distillation EMNLP 2023
Focus on the Core: Efficient Attention via Pruned Token Compression for Document Classification EMNLP 2023
Enhancing Scalability of Pre-trained Language Models via Efficient Parameter Sharing EMNLP 2023
InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT EMNLP 2023
Efficient Multilingual Language Model Compression through Vocabulary Trimming EMNLP 2023
Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models EMNLP 2023
GPT4All: An Ecosystem of Open Source Compressed Language Models EMNLP 2023