Large Language Models

Transformer Language Models without Positional Encodings Still Learn Positional Information EMNLP 2022 TruthfulQA: Measuring How Models Mimic Human Falsehoods ACL 2022 Understanding Domain Learning in Language Models Through Subpopulation Analysis EMNLP 2022 User-Centric Gender Rewriting NAACL 2022 WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models NAACL 2022 What do Large Language Models Learn beyond Language? EMNLP 2022 What GPT Knows About Who is Who ACL 2022 When a sentence does not introduce a discourse entity, Transformer-based models still sometimes refer to it NAACL 2022 When Language Model Meets Private Library EMNLP 2022 Who did what to Whom? Language models and humans respond diversely to features affecting argument hierarchy construction AACL 2022 Word Sense Disambiguation with Knowledge-Enhanced and Local Self-Attention-based Extractive Sense Comprehension COLING 2022 XDBERT: Distilling Visual Information to BERT from Cross-Modal Systems to Improve Language Understanding ACL 2022 A howling success or a working sea? Testing what BERT knows about metaphors EMNLP 2021 A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks ICLR 2021 Analyzing BERT’s Knowledge of Hypernymy via Prompting EMNLP 2021 ArabicTransformer: Efficient Large Arabic Language Model with Funnel Transformer and ELECTRA Objective EMNLP 2021 Automatically Exposing Problems with Neural Dialog Models EMNLP 2021 BASE Layers: Simplifying Training of Large, Sparse Models ICML 2021 BeliefBank: Adding Memory to a Pre-Trained Language Model for a Systematic Notion of Belief EMNLP 2021 Better Fine-Tuning by Reducing Representational Collapse ICLR 2021 CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade EMNLP 2021 Challenges in Detoxifying Language Models EMNLP 2021 ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information ACL 2021 CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation EMNLP 2021 Comprehension Based Question Answering using Bloom’s Taxonomy ACL 2021