Language Modeling

On the Hierarchical Information in a Single Contextualised Word Representation (Student Abstract) AAAI 2020 On the Robustness of Language Encoders against Grammatical Errors ACL 2020 On the Sentence Embeddings from Pre-trained Language Models EMNLP 2020 Open Domain Event Text Generation AAAI 2020 Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space EMNLP 2020 Overestimation of Syntactic Representation in Neural Language Models ACL 2020 PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation EMNLP 2020 PhoBERT: Pre-trained language models for Vietnamese EMNLP 2020 Pretrained Language Model Embryology: The Birth of ALBERT EMNLP 2020 Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoning ACL 2020 Pre-training via Paraphrasing NeurIPS 2020 Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Order ACL 2020 Probabilistic Predictions of People Perusing: Evaluating Metrics of Language Model Performance for Psycholinguistic Modeling EMNLP 2020 Probing for Referential Information in Language Models ACL 2020 Probing Linguistic Systematicity ACL 2020 Probing Pretrained Language Models for Lexical Semantics EMNLP 2020 ProphetNet: Predicting Future N-gram for Sequence-to-SequencePre-training EMNLP 2020 Quantifying the Contextualization of Word Representations with Semantic Class Probing EMNLP 2020 Rare Words: A Major Problem for Contextualized Embeddings and How to Fix it by Attentive Mimicking AAAI 2020 Recollection versus Imagination: Exploring Human Memory and Cognition via Neural Language Models ACL 2020 Recurrent Neural Network Language Models Always Learn English-Like Relative Clause Attachment ACL 2020 Reducing Sentiment Bias in Language Models via Counterfactual Evaluation EMNLP 2020 Reformulating Unsupervised Style Transfer as Paraphrase Generation EMNLP 2020 Re-framing Incremental Deep Language Models for Dialogue Processing with Multi-task Learning COLING 2020 Relevance-Promoting Language Model for Short-Text Conversation AAAI 2020