conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Multi-Knowledge Aggregation and Transfer for Semantic Segmentation AAAI 2022
Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-Guided Feature Imitation AAAI 2022
Convolutional Neural Network Compression through Generalized Kronecker Product Decomposition AAAI 2022
When Chosen Wisely, More Data Is What You Need: A Universal Sample-Efficient Strategy For Data Augmentation ACL 2022
Compression of Generative Pre-trained Language Models via Quantization ACL 2022
Occlusion Resistant Network for 3D Face Reconstruction WACV 2022
Structured Pruning Learns Compact and Accurate Models ACL 2022
An Effective, Performant Named Entity Recognition System for Noisy Business Telephone Conversation Transcripts COLING 2022
Multi-Granularity Structural Knowledge Distillation for Language Model Compression ACL 2022
Consistent Representation Learning for Continual Relation Extraction ACL 2022
Compressing Sentence Representation for Semantic Retrieval via Homomorphic Projective Distillation ACL 2022
Kronecker Decomposition for GPT Compression ACL 2022
Overcoming Catastrophic Forgetting beyond Continual Learning: Balanced Training for Neural Machine Translation ACL 2022
Attention Temperature Matters in Abstractive Summarization Distillation ACL 2022
Knowledge-Augmented Methods for Natural Language Processing ACL 2022
Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation ACL 2022
GenCompareSum: a hybrid unsupervised summarization method using salience ACL 2022
BERT Learns to Teach: Knowledge Distillation with Meta Learning ACL 2022
Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency ACL 2022
E-LANG: Energy-Based Joint Inferencing of Super and Swift Language Models ACL 2022
Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm ACL 2022
Towards Making the Most of Cross-Lingual Transfer for Zero-Shot Neural Machine Translation ACL 2022
A Model-agnostic Data Manipulation Method for Persona-based Dialogue Generation ACL 2022
Ensembling and Knowledge Distilling of Large Sequence Taggers for Grammatical Error Correction ACL 2022
Domain Knowledge Transferring for Pre-trained Language Model via Calibrated Activation Boundary Distillation ACL 2022