conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Neural TSP Solver with Progressive Distillation AAAI 2023
Semi-attention Partition for Occluded Person Re-identification AAAI 2023
Grouped Knowledge Distillation for Deep Face Recognition AAAI 2023
MaskBooster: End-to-End Self-Training for Sparsely Supervised Instance Segmentation AAAI 2023
Learning to Imagine: Distillation-Based Interactive Context Exploitation for Dialogue State Tracking AAAI 2023
Exploring the Relative Value of Collaborative Optimisation Pathways (Student Abstract) AAAI 2023
Mixture Uniform Distribution Modeling and Asymmetric Mix Distillation for Class Incremental Learning AAAI 2023
nBIIG: A Neural BI Insights Generation System for Table Reporting AAAI 2023
Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation ACL 2023
Symbolic Chain-of-Thought Distillation: Small Models Can Also “Think” Step-by-Step ACL 2023
Gradient-based Intra-attention Pruning on Pre-trained Language Models ACL 2023
Towards Higher Pareto Frontier in Multilingual Machine Translation ACL 2023
Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization ACL 2023
Distilling Script Knowledge from Large Language Models for Constrained Language Planning ACL 2023
Lifting the Curse of Capacity Gap in Distilling Language Models ACL 2023
DISCO: Distilling Counterfactuals with Large Language Models ACL 2023
SCOTT: Self-Consistent Chain-of-Thought Distillation ACL 2023
CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity Recognition ACL 2023
Continual Knowledge Distillation for Neural Machine Translation ACL 2023
Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation ACL 2023
AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression ACL 2023
Towards Better Entity Linking with Multi-View Enhanced Distillation ACL 2023
Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models ACL 2023
Large Language Models Are Reasoning Teachers ACL 2023
A Comparative Study on the Impact of Model Compression Techniques on Fairness in Language Models ACL 2023