conftrace_

grammatical role

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

linguistic abstraction (1) contextual embedding (1) systematic generalization (1) word order (1) lexical semantics (1) attention mechanism (1) transformer architecture (1)

Papers

Systematicity Emerges in Transformers when Abstract Grammatical Roles Guide Attention NAACL 2022 When classifying grammatical role, BERT doesn’t care about word order... except when it matters ACL 2022