conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Co-Teaching Student-Model through Submission Results of Shared Task EMNLP 2021
Adam Mickiewicz University’s English-Hausa Submissions to the WMT 2021 News Translation Task EMNLP 2021
Channel-Wise Knowledge Distillation for Dense Prediction ICCV 2021
KiloNeRF: Speeding Up Neural Radiance Fields With Thousands of Tiny MLPs ICCV 2021
Cross-Category Video Highlight Detection via Set-Based Learning ICCV 2021
Automatic ICD Coding via Interactive Shared Representation Networks with Self-distillation Mechanism ACL 2021
FLAR: A Unified Prototype Framework for Few-Sample Lifelong Active Recognition ICCV 2021
Distilling Relation Embeddings from Pretrained Language Models EMNLP 2021
Universal-KD: Attention-based Output-Grounded Intermediate Layer Knowledge Distillation EMNLP 2021
Distillation-Guided Image Inpainting ICCV 2021
Towards Faster Deep Collaborative Filtering via Hierarchical Decision Networks AAAI 2021
Few-Shot Class-Incremental Learning via Relation Knowledge Distillation AAAI 2021
Emerging Properties in Self-Supervised Vision Transformers ICCV 2021
Learning Distilled Collaboration Graph for Multi-Agent Perception NIPS 2021
Novel Visual Category Discovery with Dual Ranking Statistics and Mutual Knowledge Distillation NIPS 2021
Object DGCNN: 3D Object Detection using Dynamic Graphs NIPS 2021
Instance-Conditional Knowledge Distillation for Object Detection NIPS 2021
Learning Student-Friendly Teacher Networks for Knowledge Distillation NIPS 2021
PDALN: Progressive Domain Adaptation over a Pre-trained Model for Low-Resource Cross-Domain Named Entity Recognition EMNLP 2021
Comprehensive Knowledge Distillation with Causal Intervention NIPS 2021
Generating Long Financial Report using Conditional Variational Autoencoders with Knowledge Distillation AAAI 2021
Diversity Matters When Learning From Ensembles NIPS 2021
Mutual-Learning Improves End-to-End Speech Translation EMNLP 2021
Improving Tree-Structured Decoder Training for Code Generation via Mutual Learning AAAI 2021
Domain-Lifelong Learning for Dialogue State Tracking via Knowledge Preservation Networks EMNLP 2021