Large Language Models

Finding Skill Neurons in Pre-trained Transformer-based Language Models EMNLP 2022 Finding the Dominant Winning Ticket in Pre-Trained Language Models ACL 2022 Fine-tuned Language Models are Continual Learners EMNLP 2022 Fine-tuning language models to find agreement among humans with diverse preferences NeurIPS 2022 Fine-Tuning Pre-Trained Language Models Effectively by Optimizing Subnetworks Adaptively NeurIPS 2022 Forecasting Future World Events With Neural Networks NeurIPS 2022 Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning EMNLP 2022 Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition EMNLP 2022 Foundation Models of Scientific Knowledge for Chemistry: Opportunities, Challenges and Lessons Learned ACL 2022 FPC: Fine-tuning with Prompt Curriculum for Relation Extraction AACL 2022 g2pW: A Conditional Weighted Softmax BERT for Polyphone Disambiguation in Mandarin Interspeech 2022 Gender Bias in BERT - Measuring and Analysing Biases through Sentiment Rating in a Realistic Downstream Classification Task NAACL 2022 Generating Training Data with Language Models: Towards Zero-Shot Language Understanding NeurIPS 2022 GLaM: Efficient Scaling of Language Models with Mixture-of-Experts ICML 2022 GLM: General Language Model Pretraining with Autoregressive Blank Infilling ACL 2022 G-MAP: General Memory-Augmented Pre-trained Language Model for Domain Tasks EMNLP 2022 GPT-NeoX-20B: An Open-Source Autoregressive Language Model ACL 2022 Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models NAACL 2022 Ground-Truth Labels Matter: A Deeper Look into Input-Label Demonstrations EMNLP 2022 Hidden State Variability of Pretrained Language Models Can Guide Computation Reduction for Transfer Learning EMNLP 2022 HIE-SQL: History Information Enhanced Network for Context-Dependent Text-to-SQL Semantic Parsing ACL 2022 HiJoNLP at SemEval-2022 Task 2: Detecting Idiomaticity of Multiword Expressions using Multilingual Pretrained Language Models SemEval 2022 HIT at SemEval-2022 Task 2: Pre-trained Language Model for Idioms Detection SemEval 2022 HITMI&T at SemEval-2022 Task 4: Investigating Task-Adaptive Pretraining And Attention Mechanism On PCL Detection SemEval 2022 HOLM: Hallucinating Objects with Language Models for Referring Expression Recognition in Partially-Observed Scenes ACL 2022