conftrace_
← Back to papers
2021 ACL ACL 2021

MergeDistill: Merging Language Models using Pre-trained Distillation

Authors

Simran Khanuja , Melvin Johnson , Partha Talukdar
Download PDF

Related papers

Simple induction of (deterministic) probabilistic finite-state automata for phonotactics by stochastic gradient descent 2021
Recognizing Reduplicated Forms: Finite-State Buffered Machines 2021
Comparative Error Analysis in Neural and Finite-state Models for Unsupervised Character-level Transduction 2021
Finite-state Model of Shupamem Reduplication 2021
Visually Grounded Follow-up Questions: a Dataset of Spatial Questions Which Require Dialogue History 2021