knowledge distillation

Analyzing and Reducing the Performance Gap in Cross-Lingual Transfer with Fine-tuning Slow and Fast ACL 2023 An Efficient and Noise-Robust Audiovisual Encoder for Audiovisual Speech Recognition Interspeech 2023 An Empirical Analysis of Leveraging Knowledge for Low-Resource Task-Oriented Semantic Parsing ACL 2023 An Ensemble Distillation Framework for Sentence Embeddings with Multilingual Round-Trip Translation AAAI 2023 A Neural Span-Based Continual Named Entity Recognition Model AAAI 2023 An Investigation of the Combination of Rehearsal and Knowledge Distillation in Continual Learning for Spoken Language Understanding Interspeech 2023 AnyDA: Anytime Domain Adaptation ICLR 2023 Application of Knowledge Distillation to Multi-Task Speech Representation Learning Interspeech 2023 Approximating Two-Layer Feedforward Networks for Efficient Transformers EMNLP 2023 Architecture, Dataset and Model-Scale Agnostic Data-Free Meta-Learning CVPR 2023 Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method ACL 2023 Are Large Kernels Better Teachers than Transformers for ConvNets? ICML 2023 A Scalable and Efficient Iterative Method for Copying Machine Learning Classifiers JMLR 2023 A Sentence Speaks a Thousand Images: Domain Generalization through Distilling CLIP with Language Guidance ICCV 2023 A Simple Concatenation can Effectively Improve Speech Translation ACL 2023 A Strong Baseline for Generalized Few-Shot Semantic Segmentation CVPR 2023 A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models ACL 2023 A Study on the Efficiency and Generalization of Light Hybrid Retrievers ACL 2023 A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training ACL 2023 A Teacher-Student Approach for Extracting Informative Speaker Embeddings From Speech Mixtures Interspeech 2023 Attend, Select and Eliminate: Accelerating Multi-turn Response Selection with Dual-attention-based Content Elimination ACL 2023 Attention-Based Depth Distillation with 3D-Aware Positional Encoding for Monocular 3D Object Detection AAAI 2023 AttTrack: Online Deep Attention Transfer for Multi-Object Tracking WACV 2023 Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation NeurIPS 2023 Augmentation with Projection: Towards an Effective and Efficient Data Augmentation Paradigm for Distillation ICLR 2023