← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Functional Ensemble Distillation NIPS 2022
Metric-guided Distillation: Distilling Knowledge from the Metric to Ranker and Retriever for Generative Commonsense Reasoning EMNLP 2022
An Effective, Performant Named Entity Recognition System for Noisy Business Telephone Conversation Transcripts COLING 2022
Towards Data-Free Domain Generalization ACML 2022
Rethinking Resolution in the Context of Efficient Video Recognition NIPS 2022
Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithms NIPS 2022
Accelerating Certified Robustness Training via Knowledge Transfer NIPS 2022
A Self-improving Skin Lesions Diagnosis Framework Via Pseudo-labeling and Self-distillation ACML 2022
Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models NIPS 2022
Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts NIPS 2022
Fairness without Demographics through Knowledge Distillation NIPS 2022
Hierarchical Channel-spatial Encoding for Communication-efficient Collaborative Learning NIPS 2022
Asymmetric Temperature Scaling Makes Larger Networks Teach Well Again NIPS 2022
A Scalable Model Specialization Framework for Training and Inference using Submodels and its Application to Speech Model Personalization INTERSPEECH 2022
DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers CVPR 2022
Decomposing NeRF for Editing via Feature Field Distillation NIPS 2022
Measuring and Reducing Model Update Regression in Structured Prediction for NLP NIPS 2022
PKD: General Distillation Framework for Object Detectors via Pearson Correlation Coefficient NIPS 2022
Decomposed Knowledge Distillation for Class-Incremental Semantic Segmentation NIPS 2022
META-GUI: Towards Multi-modal Conversational Agents on Mobile GUI EMNLP 2022
Memory Efficient Continual Learning with Transformers NIPS 2022
What Makes a "Good" Data Augmentation in Knowledge Distillation - A Statistical Perspective NIPS 2022
Fine-Tuning Pre-Trained Language Models Effectively by Optimizing Subnetworks Adaptively NIPS 2022
Knowledge Distillation via the Target-Aware Transformer CVPR 2022
Co-Advise: Cross Inductive Bias Distillation CVPR 2022