Iz Beltagy
31 papers · 2018–2024 · 6 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+11 more ↓ Show less ↑
🗺️ Taxonomy Completionist (61) 🏃 Academic Marathon · Sprint 🌍 Conference Polyglot · Silver 🌉 Interdisciplinary Bridge · Silver 🐣 Hot Topic Early Bird
👥
Mega-Team · Squad
🤝
Dynamic Duo
(14)
🧬
Topic Evolution
🧭
Keyword Pioneer
🌈
Renaissance Researcher
(5)
🔥
Unstoppable · Bronze
❓
The Questioner
(3)
⚡
Prolific Year · Prolific
💎
Century Club · Bronze
📈
Trend Setter
🗃️
Keyword Collector
(138)
Top co-authors
Research topics
Machine Learning
(21)
Deep Learning
(19)
Natural Language Processing
(19)
Learning Types · Machine Learning
(14)
Artificial Intelligence
(11)
Resources & Methods
(10)
Generation
(9)
Learning Types · Deep Learning
(9)
Models
(8)
Learning Paradigms
(7)
Applications
(6)
Application Areas
(5)
Architectures
(5)
Core AI
(5)
Core Methods
(4)
Keywords
few-shot learning
(7)
large language model
(6)
zero-shot learning
(5)
pre-trained language model
(4)
natural language processing
(4)
language model
(4)
domain adaptation
(3)
transfer learning
(3)
relation extraction
(3)
in-context learning
(3)
model scaling
(2)
text classification
(2)
model training
(2)
dependency parsing
(2)
named entity recognition
(2)
transformer architecture
(2)
information retrieval
(2)
language modeling
(2)
prompt-based learning
(2)
zero-shot generalization
(2)
Papers
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
ACL 2024
OLMo: Accelerating the Science of Language Models
ACL 2024
Paloma: A Benchmark for Evaluating Language Model Fit
NeurIPS 2024
TESS: Text-to-Text Self-Conditioned Simplex Diffusion
EACL 2024
FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning
ACL 2023
How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources
NeurIPS 2023
Z-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrations
ACL 2023
Continued Pretraining for Better Zero- and Few-Shot Promptability
EMNLP 2022
Don’t Say What You Don’t Know: Improving the Consistency of Abstractive Summarization by Constraining Beam Search
EMNLP 2022
Few-Shot Self-Rationalization with Natural Language Prompts
NAACL 2022
MultiVerS: Improving scientific claim verification with weak supervision and full-document context
NAACL 2022
PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization
ACL 2022
SciFact-Open: Towards open-domain scientific claim verification
EMNLP 2022
Staged Training for Transformer Language Models
ICML 2022
What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization?
ICML 2022
What Language Model to Train if You Have One Million GPU Hours?
EMNLP 2022
Zero- and Few-Shot NLP with Pretrained Language Models
ACL 2022
A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers
NAACL 2021
Beyond Paragraphs: NLP for Long Sequences
NAACL 2021
CDLM: Cross-Document Language Modeling
EMNLP 2021
FLEX: Unifying Evaluation for Few-Shot NLP
NeurIPS 2021
MSˆ2: Multi-Document Summarization of Medical Studies
EMNLP 2021
Overview of the Second Workshop on Scholarly Document Processing
NAACL 2021
Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks
ACL 2020
SciREX: A Challenge Dataset for Document-Level Information Extraction
ACL 2020
SPECTER: Document-level Representation Learning using Citation-informed Transformers
ACL 2020
Combining Distant and Direct Supervision for Neural Relation Extraction
NAACL 2019
Pretrained Language Models for Sequential Sentence Classification
EMNLP 2019
SciBERT: A Pretrained Language Model for Scientific Text
EMNLP 2019
ScispaCy: Fast and Robust Models for Biomedical Natural Language Processing
ACL 2019
Construction of the Literature Graph in Semantic Scholar
NAACL 2018