← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Co-training and Co-distillation for Quality Improvement and Compression of Language Models EMNLP 2023
Accelerating Multiple Intent Detection and Slot Filling via Targeted Knowledge Distillation EMNLP 2023
Learn From One Specialized Sub-Teacher: One-to-One Mapping for Feature-Based Knowledge Distillation EMNLP 2023
Synthesize, if you do not have: Effective Synthetic Dataset Creation Strategies for Self-Supervised Opinion Summarization in E-commerce EMNLP 2023
Leveraging Contrastive Learning and Knowledge Distillation for Incomplete Modality Rumor Detection EMNLP 2023
Beyond Testers’ Biases: Guiding Model Testing with Knowledge Bases using LLMs EMNLP 2023
Consistency is Key: On Data-Efficient Modality Transfer in Speech Translation EMNLP 2023
D2TV: Dual Knowledge Distillation and Target-oriented Vision Modeling for Many-to-Many Multimodal Summarization EMNLP 2023
Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models EMNLP 2023
Evaluating Parameter-Efficient Finetuning Approaches for Pre-trained Models on the Financial Domain EMNLP 2023
Machine Translation with Large Language Models: Prompting, Few-shot Learning, and Fine-tuning with QLoRA EMNLP 2023
CUNI at WMT23 General Translation Task: MT and a Genetic Algorithm EMNLP 2023
Object-Aware Distillation Pyramid for Open-Vocabulary Object Detection CVPR 2023
Distilling Focal Knowledge From Imperfect Expert for 3D Object Detection CVPR 2023
Few-Shot Class-Incremental Learning via Class-Aware Bilateral Distillation CVPR 2023
SmallCap: Lightweight Image Captioning Prompted With Retrieval Augmentation CVPR 2023
Decomposed Cross-Modal Distillation for RGB-Based Temporal Action Detection CVPR 2023
OvarNet: Towards Open-Vocabulary Object Attribute Recognition CVPR 2023
Supervised Masked Knowledge Distillation for Few-Shot Transformers CVPR 2023
Dense Network Expansion for Class Incremental Learning CVPR 2023
Data-Free Sketch-Based Image Retrieval CVPR 2023
Masked Images Are Counterfactual Samples for Robust Fine-Tuning CVPR 2023
Co-Training 2L Submodels for Visual Recognition CVPR 2023
Multi-Mode Online Knowledge Distillation for Self-Supervised Visual Representation Learning CVPR 2023
On Distillation of Guided Diffusion Models CVPR 2023