conftrace_
← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

ML Mob at SemEval-2023 Task 5: “Breaking News: Our Semi-Supervised and Multi-Task Learning Approach Spoils Clickbait” ACL 2023
Storyline-Centric Detection of Aphasia and Dysarthria in Stroke Patient Transcripts ACL 2023
Few Shot Rationale Generation using Self-Training with Dual Teachers ACL 2023
Teaching Small Language Models to Reason ACL 2023
ReAugKD: Retrieval-Augmented Knowledge Distillation For Pre-trained Language Models ACL 2023
INK: Injecting kNN Knowledge in Nearest Neighbor Machine Translation ACL 2023
A Comparative Study on the Impact of Model Compression Techniques on Fairness in Language Models ACL 2023
Large Language Models Are Reasoning Teachers ACL 2023
Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models ACL 2023
Towards Better Entity Linking with Multi-View Enhanced Distillation ACL 2023
AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression ACL 2023
Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation ACL 2023
Continual Knowledge Distillation for Neural Machine Translation ACL 2023
CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity Recognition ACL 2023
SCOTT: Self-Consistent Chain-of-Thought Distillation ACL 2023
DISCO: Distilling Counterfactuals with Large Language Models ACL 2023
Lifting the Curse of Capacity Gap in Distilling Language Models ACL 2023
Distilling Script Knowledge from Large Language Models for Constrained Language Planning ACL 2023
Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization ACL 2023
Towards Higher Pareto Frontier in Multilingual Machine Translation ACL 2023
Gradient-based Intra-attention Pruning on Pre-trained Language Models ACL 2023
Symbolic Chain-of-Thought Distillation: Small Models Can Also “Think” Step-by-Step ACL 2023
Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation ACL 2023
nBIIG: A Neural BI Insights Generation System for Table Reporting AAAI 2023
Mixture Uniform Distribution Modeling and Asymmetric Mix Distillation for Class Incremental Learning AAAI 2023