← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Teacher and Student Models of Offensive Language in Social Media ACL 2023
RHO: Reducing Hallucination in Open-domain Dialogues with Knowledge Grounding ACL 2023
Distilling Calibrated Knowledge for Stance Detection ACL 2023
Distilling Reasoning Capabilities into Smaller Language Models ACL 2023
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes ACL 2023
Distilling Efficient Language-Specific Models for Cross-Lingual Transfer ACL 2023
DiMS: Distilling Multiple Steps of Iterative Non-Autoregressive Transformers for Machine Translation ACL 2023
Adaptive Contrastive Knowledge Distillation for BERT Compression ACL 2023
Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method ACL 2023
Smart Word Suggestions for Writing Assistance ACL 2023
Domain Generalization via Switch Knowledge Distillation for Robust Review Representation ACL 2023
Better Language Models of Code through Self-Improvement ACL 2023
EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning ACL 2023
Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languages ACL 2023
D2TV: Dual Knowledge Distillation and Target-oriented Vision Modeling for Many-to-Many Multimodal Summarization EMNLP 2023
InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT EMNLP 2023
STXD: Structural and Temporal Cross-Modal Distillation for Multi-View 3D Object Detection NIPS 2023
Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models NIPS 2023
EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understanding NIPS 2023
CL-NeRF: Continual Learning of Neural Radiance Fields for Evolving Scene Representation NIPS 2023
RD-Suite: A Benchmark for Ranking Distillation NIPS 2023
Leveraging Vision-Centric Multi-Modal Expertise for 3D Object Detection NIPS 2023
Switching Temporary Teachers for Semi-Supervised Semantic Segmentation NIPS 2023
Cluster-aware Semi-supervised Learning: Relational Knowledge Distillation Provably Learns Clustering NIPS 2023
Progressive Ensemble Distillation: Building Ensembles for Efficient Inference NIPS 2023