Language Modeling

Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models EMNLP 2022 Improving Temporal Generalization of Pre-trained Language Models with Lexical Semantic Change EMNLP 2022 Improving Transformers with Probabilistic Attention Keys ICML 2022 Improving Transformer with an Admixture of Attention Heads NeurIPS 2022 Improving Zero-Shot Multilingual Text Generation via Iterative Distillation COLING 2022 Incremental Prompting: Episodic Memory Prompt for Lifelong Event Detection COLING 2022 Induced Natural Language Rationales and Interleaved Markup Tokens Enable Extrapolation in Large Language Models EMNLP 2022 Inducer-tuning: Connecting Prefix-tuning and Adapter-tuning EMNLP 2022 InforMask: Unsupervised Informative Masking for Language Model Pretraining EMNLP 2022 InsNet: An Efficient, Flexible, and Performant Insertion-based Text Generation Model NeurIPS 2022 Instance Regularization for Discriminative Language Model Pre-training EMNLP 2022 Intrinsic Gradient Compression for Scalable and Efficient Federated Learning ACL 2022 Investigating perception of spoken dialogue acceptability through surprisal Interspeech 2022 Is anisotropy really the cause of BERT embeddings not being semantic? EMNLP 2022 Is Neural Topic Modelling Better than Clustering? An Empirical Study on Clustering with Contextual Embeddings for Topics NAACL 2022 “Is Whole Word Masking Always Better for Chinese BERT?”: Probing on Chinese Grammatical Error Correction ACL 2022 JAKET: Joint Pre-training of Knowledge Graph and Language Understanding AAAI 2022 JANUS: Joint Autoregressive and Non-autoregressive Training with Auxiliary Loss for Sequence Generation EMNLP 2022 Joint Language Semantic and Structure Embedding for Knowledge Graph Completion COLING 2022 KALA: Knowledge-Augmented Language Model Adaptation NAACL 2022 KERPLE: Kernelized Relative Positional Embedding for Length Extrapolation NeurIPS 2022 KinyaBERT: a Morphology-aware Kinyarwanda Language Model ACL 2022 KNOT: Knowledge Distillation Using Optimal Transport for Solving NLP Tasks COLING 2022 Knowledge-Augmented Methods for Natural Language Processing ACL 2022 Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks EMNLP 2022