conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Self-Supervised Representation Learning With Cross-Context Learning Between Global and Hypercolumn Features WACV 2024
Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning ACL 2024
Revisiting Knowledge Distillation for Autoregressive Language Models ACL 2024
Three Heads Are Better than One: Improving Cross-Domain NER with Progressive Decomposed Network AAAI 2024
LLM vs Small Model? Large Language Model Based Text Augmentation Enhanced Personality Detection Model AAAI 2024
Is a Large Language Model a Good Annotator for Event Extraction? AAAI 2024
Omnipotent Distillation with LLMs for Weakly-Supervised Natural Language Video Localization: When Divergence Meets Consistency AAAI 2024
SimDistill: Simulated Multi-Modal Distillation for BEV 3D Object Detection AAAI 2024
AltDiffusion: A Multilingual Text-to-Image Diffusion Model AAAI 2024
Understanding the Role of the Projector in Knowledge Distillation AAAI 2024
LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions EACL 2024
Distillation Enhanced Generative Retrieval ACL 2024
RECOST: External Knowledge Guided Data-efficient Instruction Tuning ACL 2024
Optimal Transport Guided Correlation Assignment for Multimodal Entity Linking ACL 2024
FedCD: Federated Semi-Supervised Learning with Class Awareness Balance via Dual Teachers AAAI 2024
Bi-ViT: Pushing the Limit of Vision Transformer Quantization AAAI 2024
PTMQ: Post-training Multi-Bit Quantization of Neural Networks AAAI 2024
LSTKC: Long Short-Term Knowledge Consolidation for Lifelong Person Re-identification AAAI 2024
Exploring One-Shot Semi-supervised Federated Learning with Pre-trained Diffusion Models AAAI 2024
MolTRES: Improving Chemical Language Representation Learning for Molecular Property Prediction EMNLP 2024
MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classification EMNLP 2024
Flipped Classroom: Aligning Teacher Attention with Student in Generalized Category Discovery NIPS 2024
Generation, Distillation and Evaluation of Motivational Interviewing-Style Reflections with a Foundational Language Model EACL 2024
Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation EMNLP 2024
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts NIPS 2024