sequence-level distillation

Encoder-Aware Sequence-Level Knowledge Distillation for Low-Resource Neural Machine Translation NAACL 2025 Memorization Inheritance in Sequence-Level Knowledge Distillation for Neural Machine Translation ACL 2025 Accurate Knowledge Distillation via n-best Reranking NAACL 2024 Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation EMNLP 2024 RA2FD: Distilling Faithfulness into Efficient Dialogue Systems EMNLP 2024 A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training ACL 2023 Enhancing Abstractiveness of Summarization Models through Calibrated Distillation EMNLP 2023 f-Divergence Minimization for Sequence-Level Knowledge Distillation ACL 2023 Selective Knowledge Distillation for Non-Autoregressive Neural Machine Translation AAAI 2023 Self-Improvement of Non-autoregressive Model via Sequence-Level Distillation EMNLP 2023 Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation ACL 2023 Autoregressive Knowledge Distillation through Imitation Learning EMNLP 2020 Large Scale Weakly and Semi-Supervised Learning for Low-Resource Video ASR Interspeech 2020 Compression of CTC-Trained Acoustic Models by Dynamic Frame-Wise Distillation or Segment-Wise N-Best Hypotheses Imitation Interspeech 2019