knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

ECLIPSE: Efficient Continual Learning in Panoptic Segmentation with Visual Prompt Tuning CVPR 2024

Benchmarking Diffusion Models for Machine Translation EACL 2024

Minimal Distillation Schedule for Extreme Language Model Compression EACL 2024

Cross-model Control: Improving Multiple Large Language Models in One-time Training NIPS 2024

EnOF-SNN: Training Accurate Spiking Neural Networks via Enhancing the Output Feature NIPS 2024

LLM-based Multi-Level Knowledge Generation for Few-shot Knowledge Graph Completion IJCAI 2024

Efficient Stitchable Task Adaptation CVPR 2024

Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning ACL 2024

Sentence-wise Speech Summarization: Task, Datasets, and End-to-End Modeling with LM Knowledge Distillation INTERSPEECH 2024

Uncertainty-Guided Never-Ending Learning to Drive CVPR 2024

Archimedes-AUEB at SemEval-2024 Task 5: LLM explains Civil Procedure SEMEVAL 2024

Pauk at SemEval-2024 Task 4: A Neuro-Symbolic Method for Consistent Classification of Propaganda Techniques in Memes SEMEVAL 2024

Leveraging Vision-Language Models for Improving Domain Generalization in Image Classification CVPR 2024

Joint Input and Output Coordination for Class-Incremental Learning IJCAI 2024

Large Language Model Guided Knowledge Distillation for Time Series Anomaly Detection IJCAI 2024

Provable Partially Observable Reinforcement Learning with Privileged Information NIPS 2024

ECLIPSE: A Resource-Efficient Text-to-Image Prior for Image Generations CVPR 2024

BabyLM Challenge: Experimenting with Self-Distillation and Reverse-Distillation for Language Model Pre-Training on Constrained Datasets CONLL 2024

Further Compressing Distilled Language Models via Frequency-aware Partial Sparse Coding of Embeddings CONLL 2024

CaKDP: Category-aware Knowledge Distillation and Pruning Framework for Lightweight 3D Object Detection CVPR 2024

Influential Exemplar Replay for Incremental Learning in Recommender Systems AAAI 2024

Building Variable-Sized Models via Learngene Pool AAAI 2024

Enhancing Job Recommendation through LLM-Based Generative Adversarial Networks AAAI 2024

Improving Audio Codec-based Zero-Shot Text-to-Speech Synthesis with Multi-Modal Context and Large Language Model INTERSPEECH 2024

Sign Value Constraint Decomposition for Efficient 1-Bit Quantization of Speech Translation Tasks INTERSPEECH 2024