conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Efficient Speaker Embedding Extraction Using a Twofold Sliding Window Algorithm for Speaker Diarization INTERSPEECH 2024
Enhancing Low-Resource NMT with a Multilingual Encoder and Knowledge Distillation: A Case Study ACL 2024
Exploring compressibility of transformer based text-to-music (TTM) models INTERSPEECH 2024
Compact Speech Translation Models via Discrete Speech Units Pretraining ACL 2024
CTC-based Non-autoregressive Textless Speech-to-Speech Translation ACL 2024
Speedy Gonzales: A Collection of Fast Task-Specific Models for Spanish NAACL 2024
UniADS: Universal Architecture-Distiller Search for Distillation Gap AAAI 2024
Federated Learning with Extremely Noisy Clients via Negative Distillation AAAI 2024
Learn to Rectify the Bias of CLIP for Unsupervised Semantic Segmentation CVPR 2024
Large Language Models for Data Annotation and Synthesis: A Survey EMNLP 2024
AMR-Evol: Adaptive Modular Response Evolution Elicits Better Knowledge Distillation for Large Language Models in Code Generation EMNLP 2024
tinyCLAP: Distilling Constrastive Language-Audio Pretrained Models INTERSPEECH 2024
Study Selectively: An Adaptive Knowledge Distillation based on a Voting Network for Heart Sound Classification INTERSPEECH 2024
DecorateLM: Data Engineering through Corpus Rating, Tagging, and Editing with Language Models EMNLP 2024
TinyChart: Efficient Chart Understanding with Program-of-Thoughts Learning and Visual Token Merging EMNLP 2024
Unsupervised Human Preference Learning EMNLP 2024
Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale EMNLP 2024
Advancing Large Language Model Attribution through Self-Improving EMNLP 2024
AlignCap: Aligning Speech Emotion Captioning to Human Preferences EMNLP 2024
Teaching Small Language Models Reasoning through Counterfactual Distillation EMNLP 2024
Investigating Mysteries of CoT-Augmented Distillation EMNLP 2024
An Empirical Study of Multilingual Reasoning Distillation for Question Answering EMNLP 2024
MIND: Multimodal Shopping Intention Distillation from Large Vision-language Models for E-commerce Purchase Understanding EMNLP 2024
QBB: Quantization with Binary Bases for LLMs NIPS 2024
SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors NIPS 2024