conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Multi-Scale Distillation from Multiple Graph Neural Networks AAAI 2022
Federated Class-Incremental Learning CVPR 2022
Diversifying Neural Dialogue Generation via Negative Distillation NAACL 2022
On the Use of External Data for Spoken Named Entity Recognition NAACL 2022
MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation NAACL 2022
Don’t Take It Literally: An Edit-Invariant Sequence Loss for Text Generation NAACL 2022
KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation NAACL 2022
Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Models NAACL 2022
Re2G: Retrieve, Rerank, Generate NAACL 2022
One Reference Is Not Enough: Diverse Distillation with Reference Selection for Non-Autoregressive Translation NAACL 2022
Is Neural Topic Modelling Better than Clustering? An Empirical Study on Clustering with Contextual Embeddings for Topics NAACL 2022
Knowledge Inheritance for Pre-trained Language Models NAACL 2022
Leaner and Faster: Two-Stage Model Compression for Lightweight Text-Image Retrieval NAACL 2022
Collective Relevance Labeling for Passage Retrieval NAACL 2022
Causal Distillation for Language Models NAACL 2022
Learning Cross-Lingual IR from an English Retriever NAACL 2022
Symbolic Knowledge Distillation: from General Language Models to Commonsense Models NAACL 2022
Nearest Neighbor Knowledge Distillation for Neural Machine Translation NAACL 2022
FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction NAACL 2022
Multi-View Attention Transfer for Efficient Speech Enhancement INTERSPEECH 2022
Distilling Representations from GAN Generator via Squeeze and Span NIPS 2022
Knowledge Distillation from A Stronger Teacher NIPS 2022
Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models INTERSPEECH 2022
Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation INTERSPEECH 2022
Knowledge Transfer and Distillation from Autoregressive to Non-Autoregessive Speech Recognition INTERSPEECH 2022