conftrace_

iterative distillation

3 papers

Explore in graph

Co-occurring keywords · papers mentioning both

knowledge distillation (3) teaching assistant (1) symbolic knowledge distillation (1) reference-free training (1) large language model (1) teacher-student architecture (1) dense passage retrieval (1) sentence summarization (1) text compression (1) language model (1)

Papers

SIKeD: Self-guided Iterative Knowledge Distillation for Mathematical Reasoning ACL 2025 MTA4DPR: Multi-Teaching-Assistants Based Iterative Knowledge Distillation for Dense Passage Retrieval EMNLP 2024 Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillation EMNLP 2022