Language Models

hULMonA: The Universal Language Model in Arabic ACL 2019 Identification of Adjective-Noun Neologisms using Pretrained Language Models ACL 2019 Interpolated Spectral NGram Language Models ACL 2019 Investigating BERT’s Knowledge of Language: Five Analysis Methods with NPIs EMNLP 2019 Knowledge Enhanced Contextual Word Representations EMNLP 2019 Language Modelling Makes Sense: Propagating Representations through WordNet for Full-Coverage Word Sense Disambiguation ACL 2019 Language Models as Knowledge Bases? EMNLP 2019 Learning to Screen for Fast Softmax Inference on Large Vocabulary Neural Networks ICLR 2019 Mixtape: Breaking the Softmax Bottleneck Efficiently NeurIPS 2019 Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answering EMNLP 2019 Neural Linguistic Steganography EMNLP 2019 Neural Machine Translation with Soft Prototype NeurIPS 2019 Ouroboros: On Accelerating Training of Transformer-Based Language Models NeurIPS 2019 Parameter-free Sentence Embedding via Orthogonal Basis EMNLP 2019 Representation of Constituents in Neural Language Models: Coordination Phrase as a Case Study EMNLP 2019 SciBERT: A Pretrained Language Model for Scientific Text EMNLP 2019 Simple and Effective Noisy Channel Modeling for Neural Machine Translation EMNLP 2019 Spell Once, Summon Anywhere: A Two-Level Open-Vocabulary Language Model AAAI 2019 textTOvec: DEEP CONTEXTUALIZED NEURAL AUTOREGRESSIVE TOPIC MODELS OF LANGUAGE WITH DISTRIBUTED COMPOSITIONAL PRIOR ICLR 2019 The Unreasonable Effectiveness of Transformer Language Models in Grammatical Error Correction ACL 2019 Towards Sentence-Level Brain Decoding with Distributed Representations AAAI 2019 Towards Understanding of Medical Randomized Controlled Trials by Conclusion Generation EMNLP 2019 Unbabel’s Submission to the WMT2019 APE Shared Task: BERT-Based Encoder-Decoder for Automatic Post-Editing ACL 2019 Unified Language Model Pre-training for Natural Language Understanding and Generation NeurIPS 2019 Visualizing and Understanding the Effectiveness of BERT EMNLP 2019