conftrace_

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

What Knowledge Gets Distilled in Knowledge Distillation? NIPS 2023

Towards Efficient Pre-Trained Language Model via Feature Correlation Distillation NIPS 2023

Learning From Biased Soft Labels NIPS 2023

NPCL: Neural Processes for Uncertainty-Aware Continual Learning NIPS 2023

NEO-KD: Knowledge-Distillation-Based Adversarial Training for Robust Multi-Exit Neural Networks NIPS 2023

L2T-DLN: Learning to Teach with Dynamic Loss Network NIPS 2023

Collaborative Multi-Teacher Knowledge Distillation for Learning Low Bit-Width Deep Neural Networks WACV 2023

Understanding the Role of Mixup in Knowledge Distillation: An Empirical Study WACV 2023

Distilled Reverse Attention Network for Open-world Compositional Zero-Shot Learning ICCV 2023

Global Knowledge Calibration for Fast Open-Vocabulary Segmentation ICCV 2023

TripLe: Revisiting Pretrained Model Reuse and Progressive Learning for Efficient Vision Transformer Scaling and Searching ICCV 2023

DREAM: Efficient Dataset Distillation by Representative Matching ICCV 2023

Teacher Assistant-Based Knowledge Distillation Extracting Multi-level Features on Single Channel Sleep EEG IJCAI 2023

Distilling Universal and Joint Knowledge for Cross-Domain Model Compression on Time Series Data IJCAI 2023

Multi-mode Neural Speech Coding Based on Deep Generative Networks INTERSPEECH 2023

Learning When to Trust Which Teacher for Weakly Supervised ASR INTERSPEECH 2023

General In-hand Object Rotation with Vision and Touch CORL 2023

ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation CORL 2023

Learn With Martian: A Tool For Creating Assignments That Can Write And Re-Write Themselves EACL 2023

Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective EACL 2023

You Can Have Your Data and Balance It Too: Towards Balanced and Efficient Multilingual Models EACL 2023

The Unreasonable Effectiveness of Large Language-Vision Models for Source-Free Video Domain Adaptation ICCV 2023

Dense 2D-3D Indoor Prediction with Sound via Aligned Cross-Modal Distillation ICCV 2023

One-Shot Generative Domain Adaptation ICCV 2023

Dual Learning with Dynamic Knowledge Distillation for Partially Relevant Video Retrieval ICCV 2023