Language Modeling

The birth of Romanian BERT EMNLP 2020 Time-aware Large Kernel Convolutions ICML 2020 Time-Aware Transformer-based Network for Clinical Notes Series Prediction MLHC 2020 To BERT or Not to BERT: Comparing Task-specific and Task-agnostic Semi-Supervised Approaches for Sequence Tagging EMNLP 2020 Torch-Struct: Deep Structured Prediction Library ACL 2020 Toward Better Storylines with Sentence-Level Language Models ACL 2020 Towards Competitive N-gram Smoothing AISTATS 2020 UnihanLM: Coarse-to-Fine Chinese-Japanese Language Model Pretraining with the Unihan Database AACL 2020 UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training ICML 2020 USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation ACL 2020 Vokenization: Improving Language Understanding with Contextualized, Visual-Grounded Supervision EMNLP 2020 What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding EMNLP 2020 Which *BERT? A Survey Organizing Contextualized Encoders EMNLP 2020 Why is penguin more similar to polar bear than to sea gull? Analyzing conceptual knowledge in distributional models ACL 2020 Word class flexibility: A deep contextualized approach EMNLP 2020 Word Frequency Does Not Predict Grammatical Knowledge in Language Models EMNLP 2020 X-FACTR: Multilingual Factual Knowledge Retrieval from Pretrained Language Models EMNLP 2020 XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation EMNLP 2020 Adaptive Attention Span in Transformers ACL 2019 Adaptive Input Representations for Neural Language Modeling ICLR 2019 Adaptively Sparse Transformers EMNLP 2019 A Framework for Decoding Event-Related Potentials from Text NAACL 2019 A Generalized Language Model in Tensor Space AAAI 2019 Analysing Neural Language Models: Contextual Decomposition Reveals Default Reasoning in Number and Gender Assignment CoNLL 2019 Analyzing the Structure of Attention in a Transformer Language Model ACL 2019