Anirudh Ravula

4 papers · 2020–2021 · 4 venues · across top CS/AI venues

Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.

Achievements

Jump to papers ↓

🌍 Conference Polyglot · Bronze 🌉 Interdisciplinary Bridge · Bronze 🐣 Hot Topic Early Bird

Venues

ACL (1) EACL (1) EMNLP (1) NeurIPS (1)

Top co-authors

Joshua Ainslie (3) Philip Pham (2) Qifan Wang (2) Ruining He (2) Bhargav Kanagal (2) Chris Alberti (2) Santiago Ontanon (2) Li Yang (2) Ilya Eckstein (1) Fei Sha (1)

Research topics

Natural Language Processing (3) Deep Learning (2) Architectures (2) Resources & Methods (2) Artificial Intelligence (1) Machine Learning (1) Applications (1) Core AI (1) Generation (1) Learning Types · Machine Learning (1) Learning Types · Deep Learning (1) Techniques (1)

Keywords

question answering (2) transformer architecture (2) text summarization (1) knowledge base completion (1) sparse attention (1) contrastive predictive coding (1) entity representation (1) sequence length (1) genomics data (1) relative position encoding (1) ranked retrieval (1) extended transformer construction (1) global-local attention (1) long input (1) structured input (1) sparse attention mechanism (1) self-supervised learning (1)

Papers

DOCENT: Learning Self-Supervised Entity Representations from Large Document Collections EACL 2021 RealFormer: Transformer Likes Residual Attention ACL 2021 Big Bird: Transformers for Longer Sequences NeurIPS 2020 ETC: Encoding Long and Structured Inputs in Transformers EMNLP 2020