conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Leveraging Denoised Abstract Meaning Representation for Grammatical Error Correction ACL 2023
Cost-effective Distillation of Large Language Models ACL 2023
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes ACL 2023
A Scalable and Efficient Iterative Method for Copying Machine Learning Classifiers JMLR 2023
Improving End-to-End SLU performance with Prosodic Attention and Distillation INTERSPEECH 2023
Automated Knowledge Distillation via Monte Carlo Tree Search ICCV 2023
Synthetic Pre-Training Tasks for Neural Machine Translation ACL 2023
FedNoRo: Towards Noise-Robust Federated Learning by Addressing Class Imbalance and Label Noise Heterogeneity IJCAI 2023
CoNMix for Source-Free Single and Multi-Target Domain Adaptation WACV 2023
Large-to-Small Image Resolution Asymmetry in Deep Metric Learning WACV 2023
GlobalFlowNet: Video Stabilization Using Deep Distilled Global Motion Estimates WACV 2023
Unsupervised Adaptation with Quality-Aware Masking to Improve Target-Speaker Voice Activity Detection for Speaker Diarization INTERSPEECH 2023
Sentence Embedder Guided Utterance Encoder (SEGUE) for Spoken Language Understanding INTERSPEECH 2023
A Metric-Driven Approach to Conformer Layer Pruning for Efficient ASR Inference INTERSPEECH 2023
Recent Advances in Direct Speech-to-text Translation IJCAI 2023
Exploring Effective Inter-Encoder Semantic Interaction for Document-Level Relation Extraction IJCAI 2023
Knowledge Distillation from Non-streaming to Streaming ASR Encoder using Auxiliary Non-streaming Layer INTERSPEECH 2023
Accelerating Dataset Distillation via Model Augmentation CVPR 2023
Adaptive Data-Free Quantization CVPR 2023
GeoMIM: Towards Better 3D Knowledge Transfer via Masked Image Modeling for Multi-view 3D Understanding ICCV 2023
A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentation ICCV 2023
Acoustic NLOS Imaging with Cross Modal Knowledge Distillation IJCAI 2023
Recycle-and-Distill: Universal Compression Strategy for Transformer-based Speech SSL Models with Attention Map Reusing and Masking Distillation INTERSPEECH 2023
Teaching What You Should Teach: A Data-Based Distillation Method IJCAI 2023
Protecting Language Generation Models via Invisible Watermarking ICML 2023