conftrace_

self-attention model

6 papers

Explore in graph

Co-occurring keywords

dependency parsing (803) autoregressive training (3) least square (101) data pipeline (11) multi-head self-attention (37) multi-head attention (172) masked language modeling (316) pivot language (23) multilingual bert (159) pivot translation (16)

Papers

Attention Sinks Are Provably Necessary in Softmax Transformers: Evidence from Trigger-Conditional Tasks ACL 2026
On Mesa-Optimization in Autoregressively Trained Transformers: Emergence and Capability NIPS 2024
Unsupervised Dependency Graph Network ACL 2022
Multilingual Dependency Parsing for Low-Resource African Languages: Case Studies on Bambara, Wolof, and Yoruba IJCNLP 2021
Detect Profane Language in Streaming Services to Protect Young Audiences ACL 2021
The TALP-UPC Machine Translation Systems for WMT19 News Translation Task: Pivoting Techniques for Low Resource MT ACL 2019