conftrace_
← Back to papers
2021 ACL ACL 2021

Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains

Authors

Yunzhi Yao , Shaohan Huang , Wenhui Wang , Li Dong , Furu Wei
Download PDF

Related papers

Simple induction of (deterministic) probabilistic finite-state automata for phonotactics by stochastic gradient descent 2021
Recognizing Reduplicated Forms: Finite-State Buffered Machines 2021
Comparative Error Analysis in Neural and Finite-state Models for Unsupervised Character-level Transduction 2021
Finite-state Model of Shupamem Reduplication 2021
Visually Grounded Follow-up Questions: a Dataset of Spatial Questions Which Require Dialogue History 2021