conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

DIMSIM: Distilled Multilingual Critics for Indic Text Simplification ACL 2024
Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detection AAAI 2024
Efficient Toxic Content Detection by Bootstrapping and Distilling Large Language Models AAAI 2024
DDViT: Double-Level Fusion Domain Adapter Vision Transformer (Student Abstract) AAAI 2024
No Head Left Behind – Multi-Head Alignment Distillation for Transformers AAAI 2024
Self-Distillation Regularized Connectionist Temporal Classification Loss for Text Recognition: A Simple Yet Effective Approach AAAI 2024
Distilled Datamodel with Reverse Gradient Matching CVPR 2024
Consistency Policy: Accelerated Visuomotor Policies via Consistency Distillation RSS 2024
Exploiting CLIP for Zero-Shot HOI Detection Requires Knowledge Distillation at Multiple Levels WACV 2024
Using Early Readouts To Mediate Featural Bias in Distillation WACV 2024
Cutting the Black Box: Conceptual Interpretation of a Deep Neural Net with Multi-Modal Embeddings and Multi-Criteria Decision Aid IJCAI 2024
D3ETR: Decoder Distillation for Detection Transformer IJCAI 2024
Label-efficient Semantic Scene Completion with Scribble Annotations IJCAI 2024
Navigating Continual Test-time Adaptation with Symbiosis Knowledge IJCAI 2024
Bridging Language Gaps in Audio-Text Retrieval INTERSPEECH 2024
Beyond Full Fine-tuning: Harnessing the Power of LoRA for Multi-Task Instruction Tuning COLING 2024
Can Small Language Models Help Large Language Models Reason Better?: LM-Guided Chain-of-Thought COLING 2024
Enhancing Code Generation Performance of Smaller Models by Distilling the Reasoning Ability of LLMs COLING 2024
MT-PATCHER: Selective and Extendable Knowledge Distillation from Large Language Models for Machine Translation NAACL 2024
ToXCL: A Unified Framework for Toxic Speech Detection and Explanation NAACL 2024
CodecLM: Aligning Language Models with Tailored Synthetic Data NAACL 2024
Ranking Entities along Conceptual Space Dimensions with LLMs: An Analysis of Fine-Tuning Strategies ACL 2024
Let All Be Whitened: Multi-Teacher Distillation for Efficient Visual Retrieval AAAI 2024
Privileged Prior Information Distillation for Image Matting AAAI 2024
M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation ACL 2024