Anirudh Ravula
5 papers · 2020–2021 · 5 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+1 more ↓ Show less ↑
π Conference Polyglot (5) π Interdisciplinary Bridge πΊοΈ Taxonomy Completionist (10) π§ Keyword Pioneer π£ Hot Topic Early Bird
π
Cross-Pollinator
(15)
Conferences
ACL (1)
EACL (1)
EMNLP (1)
IJCNLP (1)
NIPS (1)
Top co-authors
Keywords
question answering
(2)
transformer architecture
(2)
text summarization
(1)
knowledge base completion
(1)
sparse attention
(1)
contrastive predictive coding
(1)
entity representation
(1)
sequence length
(1)
genomics datum
(1)
relative position encoding
(1)
ranked retrieval
(1)
extended transformer construction
(1)
global-local attention
(1)
long input
(1)
structured input
(1)
sparse attention mechanism
(1)
self-supervised learning
(1)
Papers
RealFormer: Transformer Likes Residual Attention
ACL 2021
DOCENT: Learning Self-Supervised Entity Representations from Large Document Collections
EACL 2021
RealFormer: Transformer Likes Residual Attention
IJCNLP 2021
Big Bird: Transformers for Longer Sequences
NIPS 2020
ETC: Encoding Long and Structured Inputs in Transformers
EMNLP 2020