conftrace_
← Keywords

model compression

3302 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3725) large language model (13587) neural network (6616) efficient computing (781) neural network optimization (1293) transfer learning (5449) convolutional neural network (4226) neural network pruning (265) language model (4599) parameter efficiency (417)

Papers

GlobalFlowNet: Video Stabilization Using Deep Distilled Global Motion Estimates WACV 2023
FeatER: An Efficient Network for Human Reconstruction via Feature Map-Based TransformER CVPR 2023
Robustness Challenges in Model Distillation and Pruning for Natural Language Understanding EACL 2023
Modular Transformers: Compressing Transformers into Modularized Layers for Flexible Efficient Inference ACL 2023
FaLA: Fast Linear Adaptation for Replacing Backbone Models on Edge Devices EMNLP 2023
Sharing Encoder Representations across Languages, Domains and Tasks in Large-Scale Spoken Language Understanding ACL 2023
LECO: Improving Early Exiting via Learned Exits and Comparison-based Exiting Mechanism ACL 2023
A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training ACL 2023
Teaching Small Language Models to Reason ACL 2023
Adaptive Contrastive Knowledge Distillation for BERT Compression ACL 2023
Boost Transformer-based Language Models with GPU-Friendly Sparsity and Quantization ACL 2023
CocaCLIP: Exploring Distillation of Fully-Connected Knowledge Interaction Graph for Lightweight Text-Image Retrieval ACL 2023
Dual Relation Knowledge Distillation for Object Detection IJCAI 2023
YOLO-ReT: Towards High Accuracy Real-Time Object Detection on Edge GPUs WACV 2022
Pyramid-BERT: Reducing Complexity via Successive Core-set based Token Selection ACL 2022
Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models COLING 2022
Token and Head Adaptive Transformers for Efficient Natural Language Processing COLING 2022
Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher COLING 2022
To Fold or Not to Fold: a Necessary and Sufficient Condition on Batch-Normalization Layers Folding IJCAI 2022
Data-Free Adversarial Knowledge Distillation for Graph Neural Networks IJCAI 2022
Pseudo-spherical Knowledge Distillation IJCAI 2022
MultiQuant: Training Once for Multi-bit Quantization of Neural Networks IJCAI 2022
BiFSMN: Binary Neural Network for Keyword Spotting IJCAI 2022
Neural Network Pruning by Cooperative Coevolution IJCAI 2022
Distilling Inter-Class Distance for Semantic Segmentation IJCAI 2022