knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Object Attribute Matters in Visual Question Answering AAAI 2024

ConsistencyTTA: Accelerating Diffusion-Based Text-to-Audio Generation with Consistency Distillation INTERSPEECH 2024

Complementary Knowledge Distillation for Robust and Privacy-Preserving Model Serving in Vertical Federated Learning AAAI 2024

Hear You Say You: An Efficient Framework for Marine Mammal Sounds’ Classification AAAI 2024

Do You Remember the Future? Weak-to-Strong Generalization in 3D Object Detection IJCAI 2024

An LLM-Enhanced Adversarial Editing System for Lexical Simplification COLING 2024

Class-Incremental Few-Shot Event Detection COLING 2024

Distillation with Explanations from Large Language Models COLING 2024

Effective Distillation of Table-based Reasoning Ability from LLMs COLING 2024

Evolving Knowledge Distillation with Large Language Models and Active Learning COLING 2024

Sinkhorn Distance Minimization for Knowledge Distillation COLING 2024

TAeKD: Teacher Assistant Enhanced Knowledge Distillation for Closed-Source Multilingual Neural Machine Translation COLING 2024

Task-agnostic Distillation of Encoder-Decoder Language Models COLING 2024

When Babies Teach Babies: Can student knowledge sharing outperform Teacher-Guided Distillation on small datasets? CONLL 2024

Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers (Student Abstract) AAAI 2024

COSIGN: Contextual Facts Guided Generation for Knowledge Graph Completion NAACL 2024

A Small and Fast BERT for Chinese Medical Punctuation Restoration INTERSPEECH 2024

Online Knowledge Distillation of Decoder-Only Large Language Models for Efficient Speech Recognition INTERSPEECH 2024

MISA: MIning Saliency-Aware Semantic Prior for Box Supervised Instance Segmentation IJCAI 2024

Knowledge Transfer via Compact Model in Federated Learning (Student Abstract) AAAI 2024

Large Language Model as a Policy Teacher for Training Reinforcement Learning Agents IJCAI 2024

Continual Compositional Zero-Shot Learning IJCAI 2024

Align-to-Distill: Trainable Attention Alignment for Knowledge Distillation in Neural Machine Translation COLING 2024

Self-Knowledge Distillation for Knowledge Graph Embedding COLING 2024

MadEye: Boosting Live Video Analytics Accuracy with Adaptive Camera Configurations NSDI 2024