← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity Recognition ACL 2023
Long-Tailed Question Answering in an Open World ACL 2023
Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation ACL 2023
Resolving Task Confusion in Dynamic Expansion Architectures for Class Incremental Learning AAAI 2023
One Is All: Bridging the Gap between Neural Radiance Fields Architectures with Progressive Volume Distillation AAAI 2023
Retrieval-based Knowledge Transfer: An Effective Approach for Extreme Large Language Model Compression EMNLP 2023
The student becomes the master: Outperforming GPT3 on Scientific Factual Error Correction EMNLP 2023
Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting EMNLP 2023
PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillation EMNLP 2023
Can We Edit Factual Knowledge by In-Context Learning? EMNLP 2023
Knowledge Distillation ≈ Label Smoothing: Fact or Fallacy? EMNLP 2023
Democratizing Reasoning Ability: Tailored Learning from Large Language Model EMNLP 2023
Condensing Multilingual Knowledge with Lightweight Language-Specific Modules EMNLP 2023
IAG: Induction-Augmented Generation Framework for Answering Reasoning Questions EMNLP 2023
Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models? ICML 2023
Random Teachers are Good Teachers ICML 2023
Distilling Internet-Scale Vision-Language Models into Embodied Agents ICML 2023
MDCS: More Diverse Experts with Consistency Self-distillation for Long-tailed Recognition ICCV 2023
LiDAR2Map: In Defense of LiDAR-Based Semantic Map Construction Using Online Camera Distillation CVPR 2023
LEALLA: Learning Lightweight Language-agnostic Sentence Embeddings with Knowledge Distillation EACL 2023
NaturalInversion: Data-Free Image Synthesis Improving Real-World Consistency AAAI 2022
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metrics for Automatic Text Generation ACL 2022
Overcoming Catastrophic Forgetting beyond Continual Learning: Balanced Training for Neural Machine Translation ACL 2022
Redistributing Low-Frequency Words: Making the Most of Monolingual Data in Non-Autoregressive Translation ACL 2022
Compression of Generative Pre-trained Language Models via Quantization ACL 2022