conftrace_

Clayton Fields

4 papers · 2023–2023 · 2 conferences · across top CS/AI conferences

Achievements

Jump to papers ↓

🌍 Conference Polyglot (2) 🌉 Interdisciplinary Bridge 🧭 Keyword Pioneer 🐝 Cross-Pollinator (15)

Conferences

CONLL (2) EMNLP (2)

Top co-authors

Casey Kennington (4) Andrew McMains (2) Catherine Henry (2) Osama Natouf (2)

Keywords

model compression (2) knowledge distillation (1) parameter efficiency (1) data-efficient learning (1) parameter reduction (1) data-efficient training (1) transformer model (1) compact transformer (1) pretraining from scratch (1)

Papers

Exploring Transformers as Compact, Data-efficient Language Models CONLL 2023 Tiny Language Models Enriched with Multimodal Knowledge from Multiplex Networks CONLL 2023 Tiny Language Models Enriched with Multimodal Knowledge from Multiplex Networks EMNLP 2023 Exploring Transformers as Compact, Data-efficient Language Models EMNLP 2023