conftrace_

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

Three Guidelines You Should Know for Universally Slimmable Self-Supervised Learning CVPR 2023

Making Vision Transformers Efficient From a Token Sparsification View CVPR 2023

Train-Once-for-All Personalization CVPR 2023

MDL-NAS: A Joint Multi-Domain Learning Framework for Vision Transformer CVPR 2023

Co-training and Co-distillation for Quality Improvement and Compression of Language Models EMNLP 2023

Segmented Recurrent Transformer: An Efficient Sequence-to-Sequence Model EMNLP 2023

Democratizing LLMs: An Exploration of Cost-Performance Trade-offs in Self-Refined Open-Source Models EMNLP 2023

Dynamic Low-rank Estimation for Transformer-based Language Models EMNLP 2023

Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules EMNLP 2023

Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention EMNLP 2023

SHARCS: Efficient Transformers Through Routing with Dynamic Width Sub-networks EMNLP 2023

Boosting Inference Efficiency: Unleashing the Power of Parameter-Shared Pre-trained Language Models EMNLP 2023

Learn From One Specialized Sub-Teacher: One-to-One Mapping for Feature-Based Knowledge Distillation EMNLP 2023

Focus on the Core: Efficient Attention via Pruned Token Compression for Document Classification EMNLP 2023

Enhancing Scalability of Pre-trained Language Models via Efficient Parameter Sharing EMNLP 2023

InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT EMNLP 2023

Efficient Multilingual Language Model Compression through Vocabulary Trimming EMNLP 2023

Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models EMNLP 2023

GPT4All: An Ecosystem of Open Source Compressed Language Models EMNLP 2023

A Metric-Driven Approach to Conformer Layer Pruning for Efficient ASR Inference INTERSPEECH 2023

Compressed MoE ASR Model Based on Knowledge Distillation and Quantization INTERSPEECH 2023

Equivalent Transformation and Dual Stream Network Construction for Mobile Image Super-Resolution CVPR 2023

An Efficient and Noise-Robust Audiovisual Encoder for Audiovisual Speech Recognition INTERSPEECH 2023

XiNet: Efficient Neural Networks for tinyML ICCV 2023

BiViT: Extremely Compressed Binary Vision Transformers ICCV 2023