conftrace_

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

DAMO-StreamNet: Optimizing Streaming Perception in Autonomous Driving IJCAI 2023

Low-Confidence Samples Mining for Semi-supervised Object Detection IJCAI 2023

Dual Relation Knowledge Distillation for Object Detection IJCAI 2023

RAIN: RegulArization on Input and Network for Black-Box Domain Adaptation IJCAI 2023

Distilling Coarse-to-Fine Semantic Matching Knowledge for Weakly Supervised 3D Visual Grounding ICCV 2023

One-Step Knowledge Distillation and Fine-Tuning in Using Large Pre-Trained Self-Supervised Learning Models for Speaker Verification INTERSPEECH 2023

Leveraging Semantic Information for Efficient Self-Supervised Emotion Recognition with Audio-Textual Distilled Models INTERSPEECH 2023

Co-training and Co-distillation for Quality Improvement and Compression of Language Models EMNLP 2023

New Datasets and Controllable Iterative Data Augmentation Method for Code-switching ASR Error Correction EMNLP 2023

DistillCSE: Distilled Contrastive Learning for Sentence Embeddings EMNLP 2023

Retrieval-based Knowledge Transfer: An Effective Approach for Extreme Large Language Model Compression EMNLP 2023

Accelerating Multiple Intent Detection and Slot Filling via Targeted Knowledge Distillation EMNLP 2023

Example-based Hypernetworks for Multi-source Adaptation to Unseen Domains EMNLP 2023

Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models EMNLP 2023

Domain Adaptation for Conversational Query Production with the RAG Model Feedback EMNLP 2023

LLM aided semi-supervision for efficient Extractive Dialog Summarization EMNLP 2023

HuatuoGPT, Towards Taming Language Model to Be a Doctor EMNLP 2023

Let’s Synthesize Step by Step: Iterative Dataset Synthesis with Large Language Models by Extrapolating Errors from Small Models EMNLP 2023

Noise-Robust Fine-Tuning of Pretrained Language Models via External Guidance EMNLP 2023

Learn From One Specialized Sub-Teacher: One-to-One Mapping for Feature-Based Knowledge Distillation EMNLP 2023

Sound of Story: Multi-modal Storytelling with Audio EMNLP 2023

Synthesize, if you do not have: Effective Synthetic Dataset Creation Strategies for Self-Supervised Opinion Summarization in E-commerce EMNLP 2023

Leveraging Contrastive Learning and Knowledge Distillation for Incomplete Modality Rumor Detection EMNLP 2023

kNN-CM: A Non-parametric Inference-Phase Adaptation of Parametric Text Classifiers EMNLP 2023

Cross-modality Data Augmentation for End-to-End Sign Language Translation EMNLP 2023