conftrace_

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Reinforce Data, Multiply Impact: Improved Model Accuracy and Robustness with Dataset Reinforcement ICCV 2023

Knowledge-Spreader: Learning Semi-Supervised Facial Action Dynamics by Consistifying Knowledge Granularity ICCV 2023

ORC: Network Group-based Knowledge Distillation using Online Role Change ICCV 2023

Fine-tuning Audio Spectrogram Transformer with Task-aware Adapters for Sound Event Detection INTERSPEECH 2023

Distilling knowledge from Gaussian process teacher to neural network student INTERSPEECH 2023

A Multiple-Teacher Pruning Based Self-Distillation (MT-PSD) Approach to Model Compression for Audio-Visual Wake Word Spotting INTERSPEECH 2023

Sequence-Level Knowledge Distillation for Class-Incremental End-to-End Spoken Language Understanding INTERSPEECH 2023

Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction ACL 2023

Better Language Models of Code through Self-Improvement ACL 2023

EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning ACL 2023

CLRL-Tuning: A Novel Continual Learning Approach for Automatic Speech Recognition INTERSPEECH 2023

DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation ICCV 2023

A Sentence Speaks a Thousand Images: Domain Generalization through Distilling CLIP with Language Guidance ICCV 2023

IMF: Integrating Matched Features Using Attentive Logit in Knowledge Distillation IJCAI 2023

Quantization-aware and Tensor-compressed Training of Transformers for Natural Language Understanding INTERSPEECH 2023

Efficient Controllable Multi-Task Architectures ICCV 2023

TexQ: Zero-shot Network Quantization with Texture Feature Distribution Calibration NIPS 2023

UniKD: Universal Knowledge Distillation for Mimicking Homogeneous or Heterogeneous Object Detectors ICCV 2023

QD-BEV : Quantization-aware View-guided Distillation for Multi-view 3D Object Detection ICCV 2023

Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languages ACL 2023

MEID: Mixture-of-Experts with Internal Distillation for Long-Tailed Video Recognition AAAI 2023

Boosting Graph Neural Networks via Adaptive Knowledge Distillation AAAI 2023

Extracting Low-/High- Frequency Knowledge from Graph Neural Networks and Injecting It into MLPs: An Effective GNN-to-MLP Distillation Framework AAAI 2023

Lifelong Variational Autoencoder via Online Adversarial Expansion Strategy AAAI 2023

Continual Variational Autoencoder via Continual Generative Knowledge Distillation AAAI 2023