← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

EnOF-SNN: Training Accurate Spiking Neural Networks via Enhancing the Output Feature NIPS 2024
Rethinking Knowledge Distillation With Raw Features for Semantic Segmentation WACV 2024
M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation ACL 2024
Shared-Adapters: A Novel Transformer-based Parameter Efficient Transfer Learning Approach For Children’s Automatic Speech Recognition INTERSPEECH 2024
Training a Better Chinese Spelling Correction Model via Prior-knowledge Guided Teacher ACL 2024
CycleAlign: Iterative Distillation from Black-box LLM to White-box Models for Better Human Alignment ACL 2024
LEMON: Reviving Stronger and Smaller LMs from Larger LMs with Linear Parameter Fusion ACL 2024
GoodSAM: Bridging Domain and Capacity Gaps via Segment Anything Model for Distortion-aware Panoramic Semantic Segmentation CVPR 2024
Multi-Expert Distillation for Few-Shot Coordination (Student Abstract) AAAI 2024
Efficient Feature Distillation for Zero-Shot Annotation Object Detection WACV 2024
Sinkhorn Distance Minimization for Knowledge Distillation COLING 2024
A Unified Framework for 3D Scene Understanding NIPS 2024
Task-Aware Encoder Control for Deep Video Compression CVPR 2024
Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignment ACL 2024
FRVA: Fact-Retrieval and Verification Augmented Entailment Tree Generation for Explainable Question Answering ACL 2024
Adapters Mixup: Mixing Parameter-Efficient Adapters to Enhance the Adversarial Robustness of Fine-tuned Pre-trained Text Classifiers EMNLP 2024
Learning from Imperfect Data: Towards Efficient Knowledge Distillation of Autoregressive Language Models for Text-to-SQL EMNLP 2024
Frequency Attention for Knowledge Distillation WACV 2024
A Toolbox for Modelling Engagement with Educational Videos AAAI 2024
LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Models EMNLP 2024
SDNet: An Extremely Efficient Portrait Matting Model via Self-Distillation WACV 2024
Knowledge-Preserving Pluggable Modules for Multilingual Speech Translation Tasks INTERSPEECH 2024
Differentially Private Knowledge Distillation via Synthetic Text Generation ACL 2024
Reverse Knowledge Distillation: Training a Large Model Using a Small One for Retinal Image Matching on Limited Data WACV 2024
Centrality-aware Product Retrieval and Ranking EMNLP 2024