Skip to content
conftrace_

knowledge distillation

4,137 papers

KD

Papers

On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes ICLR 2024 On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm CVPR 2024 On-the-fly Denoising for Data Augmentation in Natural Language Understanding EACL 2024 On the Learnability of Watermarks for Language Models ICLR 2024 On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving CVPR 2024 On the Surprising Effectiveness of Attention Transfer for Vision Transformers NeurIPS 2024 Ontologically Faithful Generation of Non-Player Character Dialogues EMNLP 2024 OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement ACL 2024 OpenESS: Event-based Semantic Scene Understanding with Open Vocabularies CVPR 2024 Optimal Transport Guided Correlation Assignment for Multimodal Entity Linking ACL 2024 Optimizing Chinese Lexical Simplification Across Word Types: A Hybrid Approach EMNLP 2024 Orchestrate Latent Expertise: Advancing Online Continual Learning with Multi-Level Supervision and Reverse Self-Distillation CVPR 2024 Outlier Reduction with Gated Attention for Improved Post-training Quantization in Large Sequence-to-sequence Speech Foundation Models Interspeech 2024 Out of Thin Air: Exploring Data-Free Adversarial Robustness Distillation AAAI 2024 Overcoming Data and Model heterogeneities in Decentralized Federated Learning via Synthetic Anchors ICML 2024 Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation NeurIPS 2024 PaD: Program-aided Distillation Can Teach Small Models Reasoning Better than Chain-of-thought Fine-tuning NAACL 2024 PaGoDA: Progressive Growing of a One-Step Generator from a Low-Resolution Diffusion Teacher NeurIPS 2024 PairDistill: Pairwise Relevance Distillation for Dense Retrieval EMNLP 2024 PartDistill: 3D Shape Part Segmentation by Vision-Language Model Distillation CVPR 2024 Pauk at SemEval-2024 Task 4: A Neuro-Symbolic Method for Consistent Classification of Propaganda Techniques in Memes SemEval 2024 PB-LLM: Partially Binarized Large Language Models ICLR 2024 PDF: A Probability-Driven Framework for Open World 3D Point Cloud Semantic Segmentation CVPR 2024 PeerAiD: Improving Adversarial Distillation from a Specialized Peer Tutor CVPR 2024 PELA: Learning Parameter-Efficient Models with Low-Rank Approximation CVPR 2024