conftrace_

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

One-Step Knowledge Distillation and Fine-Tuning in Using Large Pre-Trained Self-Supervised Learning Models for Speaker Verification INTERSPEECH 2023

Leveraging Semantic Information for Efficient Self-Supervised Emotion Recognition with Audio-Textual Distilled Models INTERSPEECH 2023

Co-training and Co-distillation for Quality Improvement and Compression of Language Models EMNLP 2023

New Datasets and Controllable Iterative Data Augmentation Method for Code-switching ASR Error Correction EMNLP 2023

DistillCSE: Distilled Contrastive Learning for Sentence Embeddings EMNLP 2023

Retrieval-based Knowledge Transfer: An Effective Approach for Extreme Large Language Model Compression EMNLP 2023

Accelerating Multiple Intent Detection and Slot Filling via Targeted Knowledge Distillation EMNLP 2023

Example-based Hypernetworks for Multi-source Adaptation to Unseen Domains EMNLP 2023

Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models EMNLP 2023

Domain Adaptation for Conversational Query Production with the RAG Model Feedback EMNLP 2023

LLM aided semi-supervision for efficient Extractive Dialog Summarization EMNLP 2023

HuatuoGPT, Towards Taming Language Model to Be a Doctor EMNLP 2023

Let’s Synthesize Step by Step: Iterative Dataset Synthesis with Large Language Models by Extrapolating Errors from Small Models EMNLP 2023

Noise-Robust Fine-Tuning of Pretrained Language Models via External Guidance EMNLP 2023

Learn From One Specialized Sub-Teacher: One-to-One Mapping for Feature-Based Knowledge Distillation EMNLP 2023

Sound of Story: Multi-modal Storytelling with Audio EMNLP 2023

Synthesize, if you do not have: Effective Synthetic Dataset Creation Strategies for Self-Supervised Opinion Summarization in E-commerce EMNLP 2023

Leveraging Contrastive Learning and Knowledge Distillation for Incomplete Modality Rumor Detection EMNLP 2023

kNN-CM: A Non-parametric Inference-Phase Adaptation of Parametric Text Classifiers EMNLP 2023

Cross-modality Data Augmentation for End-to-End Sign Language Translation EMNLP 2023

Consistency is Key: On Data-Efficient Modality Transfer in Speech Translation EMNLP 2023

InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT EMNLP 2023

D2TV: Dual Knowledge Distillation and Target-oriented Vision Modeling for Many-to-Many Multimodal Summarization EMNLP 2023

Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models EMNLP 2023

PersonalityChat: Conversation Distillation for Personalized Dialog Modeling with Facts and Traits EMNLP 2023