knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Multimodal Distillation for Egocentric Action Recognition ICCV 2023

DistilXLSR: A Light Weight Cross-Lingual Speech Representation Model INTERSPEECH 2023

Distilling Reasoning Capabilities into Smaller Language Models ACL 2023

SememeASR: Boosting Performance of End-to-End Speech Recognition against Domain and Long-Tailed Data Shift with Sememe Semantic Knowledge INTERSPEECH 2023

Contrastive Knowledge-Augmented Meta-Learning for Few-Shot Classification WACV 2023

Leveraging Denoised Abstract Meaning Representation for Grammatical Error Correction ACL 2023

Cost-effective Distillation of Large Language Models ACL 2023

Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes ACL 2023

A Scalable and Efficient Iterative Method for Copying Machine Learning Classifiers JMLR 2023

Improving End-to-End SLU performance with Prosodic Attention and Distillation INTERSPEECH 2023

Automated Knowledge Distillation via Monte Carlo Tree Search ICCV 2023

Synthetic Pre-Training Tasks for Neural Machine Translation ACL 2023

FedNoRo: Towards Noise-Robust Federated Learning by Addressing Class Imbalance and Label Noise Heterogeneity IJCAI 2023

CoNMix for Source-Free Single and Multi-Target Domain Adaptation WACV 2023

Large-to-Small Image Resolution Asymmetry in Deep Metric Learning WACV 2023

GlobalFlowNet: Video Stabilization Using Deep Distilled Global Motion Estimates WACV 2023

Unsupervised Adaptation with Quality-Aware Masking to Improve Target-Speaker Voice Activity Detection for Speaker Diarization INTERSPEECH 2023

Sentence Embedder Guided Utterance Encoder (SEGUE) for Spoken Language Understanding INTERSPEECH 2023

A Metric-Driven Approach to Conformer Layer Pruning for Efficient ASR Inference INTERSPEECH 2023

Recent Advances in Direct Speech-to-text Translation IJCAI 2023

Exploring Effective Inter-Encoder Semantic Interaction for Document-Level Relation Extraction IJCAI 2023

Knowledge Distillation from Non-streaming to Streaming ASR Encoder using Auxiliary Non-streaming Layer INTERSPEECH 2023

Accelerating Dataset Distillation via Model Augmentation CVPR 2023

Adaptive Data-Free Quantization CVPR 2023

GeoMIM: Towards Better 3D Knowledge Transfer via Masked Image Modeling for Multi-view 3D Understanding ICCV 2023