Omer Levy

Keep Guessing? When Considering Inference Scaling, Mind the Baselines NAACL 2025 Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model ICLR 2025 Branch-Solve-Merge Improves Large Language Model Evaluation and Generation NAACL 2024 Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length NIPS 2024 Self-Alignment with Instruction Backtranslation ICLR 2024 Altogether: Image Captioning via Re-aligning Alt-text EMNLP 2024 Instruction Induction: From Few Examples to Natural Language Task Descriptions ACL 2023 Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation NIPS 2023 LMentry: A Language Model Benchmark of Elementary Language Tasks ACL 2023 Scaling Laws for Generative Mixed-Modal Language Models ICML 2023 Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor ACL 2023 Causes and Cures for Interference in Multilingual Translation ACL 2023 LIMA: Less Is More for Alignment NIPS 2023 ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding EMNLP 2023 What Do You Get When You Cross Beam Search with Nucleus Sampling? ACL 2022 Simple Local Attentions Remain Competitive for Long-Context Tasks NAACL 2022 SCROLLS: Standardized CompaRison Over Long Language Sequences EMNLP 2022 A Few More Examples May Be Worth Billions of Parameters EMNLP 2022 Transformer Language Models without Positional Encodings Still Learn Positional Information EMNLP 2022 Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens NAACL 2022 Learning to Retrieve Passages without Supervision NAACL 2022 Cryptonite: A Cryptic Crossword Benchmark for Extreme Ambiguity in Language EMNLP 2021 Transformer Feed-Forward Layers Are Key-Value Memories EMNLP 2021 How to Train BERT with an Academic Budget EMNLP 2021 ParaShoot: A Hebrew Question Answering Dataset EMNLP 2021 Can Latent Alignments Improve Autoregressive Machine Translation? NAACL 2021 Neural Machine Translation without Embeddings NAACL 2021 Coreference Resolution without Span Representations IJCNLP 2021 Few-Shot Question Answering by Pretraining Span Selection IJCNLP 2021 Few-Shot Question Answering by Pretraining Span Selection ACL 2021 Coreference Resolution without Span Representations ACL 2021 Generalization through Memorization: Nearest Neighbor Language Models ICLR 2020 Structural Language Models of Code ICML 2020 Aligned Cross Entropy for Non-Autoregressive Machine Translation ICML 2020 BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension ACL 2020 Improving Transformer Models by Reordering their Sublayers ACL 2020 Blockwise Self-Attention for Long Document Understanding EMNLP 2020 pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference NAACL 2019 Are Sixteen Heads Really Better than One? NIPS 2019 SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems NIPS 2019 What Does BERT Look at? An Analysis of BERT’s Attention ACL 2019 BERT for Coreference Resolution: Baselines and Analysis EMNLP 2019 Mask-Predict: Parallel Decoding of Conditional Masked Language Models EMNLP 2019 Training on Synthetic Noise Improves Robustness to Natural Noise in Machine Translation EMNLP 2019 GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding ICLR 2019 code2seq: Generating Sequences from Structured Representations of Code ICLR 2019 BERT for Coreference Resolution: Baselines and Analysis IJCNLP 2019 Mask-Predict: Parallel Decoding of Conditional Masked Language Models IJCNLP 2019 Deep RNNs Encode Soft Hierarchical Syntax ACL 2018 Ultra-Fine Entity Typing ACL 2018 GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding EMNLP 2018 Simulating Action Dynamics with Neural Process Networks ICLR 2018 LSTMs Exploit Linguistic Attributes of Data ACL 2018 Long Short-Term Memory as a Dynamically Computed Element-wise Weighted Sum ACL 2018 Annotation Artifacts in Natural Language Inference Data NAACL 2018 Proceedings of the Workshop on Generalization in the Age of Deep Learning NAACL 2018 Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling ACL 2018 Named Entity Disambiguation for Noisy Text CONLL 2017 Zero-Shot Relation Extraction via Reading Comprehension CONLL 2017 A Strong Baseline for Learning Cross-Lingual Word Embeddings from Sentence Alignments EACL 2017 Annotating Relation Inference in Context via Question Answering ACL 2016 Modeling Extractive Sentence Intersection via Subtree Entailment COLING 2016 Do Supervised Distributional Methods Really Learn Lexical Inference Relations? NAACL 2015 Learning to Exploit Structured Resources for Lexical Inference CONLL 2015 The Excitement Open Platform for Textual Inferences ACL 2014 Linguistic Regularities in Sparse and Explicit Word Representations CONLL 2014 Focused Entailment Graphs for Open IE Propositions CONLL 2014 Neural Word Embedding as Implicit Matrix Factorization NIPS 2014 Dependency-Based Word Embeddings ACL 2014 Recognizing Partial Textual Entailment ACL 2013 UKP-BIU: Similarity and Entailment Metrics for Student Response Analysis SEMEVAL 2013