Language Modeling

A BERT-based Language Modeling Framework Interspeech 2022 Abstraction not Memory: BERT and the English Article System NAACL 2022 ACCoRD: A Multi-Document Approach to Generating Diverse Descriptions of Scientific Concepts EMNLP 2022 A Closer Look at Parameter Contributions When Training Neural Language and Translation Models COLING 2022 A Continuum of Generation Tasks for Investigating Length Bias and Degenerate Repetition EMNLP 2022 A Contrastive Framework for Learning Sentence Representations from Pairwise and Triple-wise Perspective in Angular Space ACL 2022 A Corpus for Understanding and Generating Moral Stories NAACL 2022 AcTune: Uncertainty-Based Active Self-Training for Active Fine-Tuning of Pretrained Language Models NAACL 2022 AdaPrompt: Adaptive Model Training for Prompt-based NLP EMNLP 2022 Adapting a Language Model While Preserving its General Knowledge EMNLP 2022 Adaptive Differential Privacy for Language Model Training ACL 2022 A Data Cartography based MixUp for Pre-trained Language Models NAACL 2022 A Domain Knowledge Enhanced Pre-Trained Language Model for Vertical Search: Case Study on Medicinal Products COLING 2022 A Knowledge-Graph-Based Intrinsic Test for Benchmarking Medical Concept Embeddings and Pretrained Language Models EMNLP 2022 Algorithms for Weighted Pushdown Automata EMNLP 2022 Analyzing Encoded Concepts in Transformer Language Models NAACL 2022 Ancestor-to-Creole Transfer is Not a Walk in the Park ACL 2022 A Neural Model for Compositional Word Embeddings and Sentence Processing ACL 2022 An Information Minimization Based Contrastive Learning Model for Unsupervised Sentence Embeddings Learning COLING 2022 Are Prompt-based Models Clueless? ACL 2022 A Simple Yet Effective Hybrid Pre-trained Language Model for Unsupervised Sentence Acceptability Prediction AACL 2022 ASR-Generated Text for Language Model Pre-training Applied to Speech Tasks Interspeech 2022 A Statistical Approach for Optimal Topic Model Identification JMLR 2022 AstBERT: Enabling Language Model for Financial Code Understanding with Abstract Syntax Trees EMNLP 2022 A Study of the Attention Abnormality in Trojaned BERTs NAACL 2022