conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-Free Continual Learning WACV 2024
Jellyfish: Instruction-Tuning Local Large Language Models for Data Preprocessing EMNLP 2024
Ontologically Faithful Generation of Non-Player Character Dialogues EMNLP 2024
LLM See, LLM Do: Leveraging Active Inheritance to Target Non-Differentiable Objectives EMNLP 2024
Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic EMNLP 2024
MLIP: Enhancing Medical Visual Representation with Divergence Encoder and Knowledge-guided Contrastive Learning CVPR 2024
Knowledge Distillation from Single-Task Teachers to Multi-Task Student for End-to-End Autonomous Driving AAAI 2024
SEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language Models EMNLP 2024
Boosting Scientific Concepts Understanding: Can Analogy from Teacher Models Empower Student Models? EMNLP 2024
FIRST: Faster Improved Listwise Reranking with Single Token Decoding EMNLP 2024
Favoring One Among Equals - Not a Good Idea: Many-to-One Matching for Robust Transformer Based Pedestrian Detection WACV 2024
Differentially Private Knowledge Distillation via Synthetic Text Generation ACL 2024
Outlier Reduction with Gated Attention for Improved Post-training Quantization in Large Sequence-to-sequence Speech Foundation Models INTERSPEECH 2024
Semi-Supervised Scene Change Detection by Distillation From Feature-Metric Alignment WACV 2024
Wakening Past Concepts Without Past Data: Class-Incremental Learning From Online Placebos WACV 2024
OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement ACL 2024
Cache & Distil: Optimising API Calls to Large Language Models ACL 2024
An Image-enhanced Molecular Graph Representation Learning Framework IJCAI 2024
AS-ES Learning: Towards efficient CoT learning in small models ACL 2024
Are Large-scale Soft Labels Necessary for Large-scale Dataset Distillation? NIPS 2024
LLM Performance Predictors are good initializers for Architecture Search ACL 2024
GoodSAM: Bridging Domain and Capacity Gaps via Segment Anything Model for Distortion-aware Panoramic Semantic Segmentation CVPR 2024
CrossKD: Cross-Head Knowledge Distillation for Object Detection CVPR 2024
Learning Continual Compatible Representation for Re-indexing Free Lifelong Person Re-identification CVPR 2024
Distilling Semantic Priors from SAM to Efficient Image Restoration Models CVPR 2024