← Learning Types
Machine Learning › Learning Types ›

Knowledge Distillation

503 directly classified papers

Papers per year

Papers

Harnessing Black-Box Control to Boost Commonsense in LM’s Generation EMNLP 2023
Evaluating the Knowledge Base Completion Potential of GPT EMNLP 2023
Mixture-of-Linguistic-Experts Adapters for Improving and Interpreting Pre-trained Language Models EMNLP 2023
Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-Intensive Tasks NIPS 2023
Do Pre-trained Models Benefit Knowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach ACL 2022
Knowledge-Augmented Language Models for Cause-Effect Relation Classification ACL 2022
Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapters ACL 2022
Domain-specific knowledge distillation yields smaller and better models for conversational commerce ACL 2022
Knowledge Distillation Meets Few-Shot Learning: An Approach for Few-Shot Intent Classification Within and Across Domains ACL 2022
Too Brittle to Touch: Comparing the Stability of Quantization and Distillation towards Developing Low-Resource MT Models EMNLP 2022
An Efficient Active Learning Pipeline for Legal Text Classification EMNLP 2022
CDGP: Automatic Cloze Distractor Generation based on Pre-trained Language Model EMNLP 2022
Faithful to the Document or to the World? Mitigating Hallucinations via Entity-Linked Knowledge in Abstractive Summarization EMNLP 2022
Boosting 3D Object Detection by Simulating Multimodality on Point Clouds CVPR 2022
Meta-Learning with Self-Improving Momentum Target NIPS 2022
InsNet: An Efficient, Flexible, and Performant Insertion-based Text Generation Model NIPS 2022
Weighted Distillation with Unlabeled Examples NIPS 2022
PKD: General Distillation Framework for Object Detectors via Pearson Correlation Coefficient NIPS 2022
Fairness without Demographics through Knowledge Distillation NIPS 2022
Measuring and Reducing Model Update Regression in Structured Prediction for NLP NIPS 2022
Biomedical NER for the Enterprise with Distillated BERN2 and the Kazu Framework EMNLP 2022
Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing NIPS 2022
Adversarial Data Augmentation for Task-Specific Knowledge Distillation of Pre-trained Transformers AAAI 2022
Knowledge Distillation via Constrained Variational Inference AAAI 2022
Tutoring Helps Students Learn Better: Improving Knowledge Distillation for BERT with Tutor Network EMNLP 2022