ACL 2022

1,617 papers

Foundation Models of Scientific Knowledge for Chemistry: Opportunities, Challenges and Lessons Learned

Sameera Horawalavithana, Ellyn Ayton, Shivam Sharma, Scott Howland, Megha Subramanian

Emergent Structures and Training Dynamics in Large Language Models

Ryan Teehan, Miruna Clinciu, Oleg Serikov, Eliza Szczechla, Natasha Seelam

Dataset Debt in Biomedical Language Modeling

Jason Fries, Natasha Seelam, Gabriel Altay, Leon Weber, Myungsun Kang

GPT-NeoX-20B: An Open-Source Autoregressive Language Model

Sidney Black, Stella Biderman, Eric Hallahan, Quentin Anthony, Leo Gao

A Holistic Assessment of the Carbon Footprint of Noor, a Very Large Arabic Language Model

Imad Lakim, Ebtesam Almazrouei, Ibrahim Abualhaol, Merouane Debbah, Julien Launay

Entities, Dates, and Languages: Zero-Shot on Historical Texts with T0

Francesco De Toni, Christopher Akiki, Javier de la Rosa, Clémentine Fourrier, Enrique Manjavacas

Pipelines for Social Bias Testing of Large Language Models

Debora Nozza, Federico Bianchi, Dirk Hovy

UNIREX: A Unified Learning Framework for Language Model Rationale Extraction

Aaron Chan, Maziar Sanjabi, Lambert Mathias, Liang Tan, Shaoliang Nie

Diverse Lottery Tickets Boost Ensemble from a Single Pretrained Model

Sosuke Kobayashi, Shun Kiyono, Jun Suzuki, Kentaro Inui

You reap what you sow: On the Challenges of Bias Evaluation Under Multilingual Settings

Zeerak Talat, Aurélie Névéol, Stella Biderman, Miruna Clinciu, Manan Dey

Using ASR-Generated Text for Spoken Language Modeling

Nicolas Hervé, Valentin Pelloin, Benoit Favre, Franck Dary, Antoine Laurent

Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora

Xisen Jin, Dejiao Zhang, Henghui Zhu, Wei Xiao, Shang-Wen Li

What is wrong with you?: Leveraging User Sentiment for Automatic Dialog Evaluation

Sarik Ghazarian, Behnam Hedayatnia, Alexandros Papangelis, Yang Liu, Dilek Hakkani-Tur

On Length Divergence Bias in Textual Matching Models

Lan Jiang, Tianshu Lyu, Yankai Lin, Meng Chong, Xiaoyong Lyu

Towards Few-shot Entity Recognition in Document Images: A Label-aware Sequence-to-Sequence Framework

Zilong Wang, Jingbo Shang

Towards Collaborative Neural-Symbolic Graph Semantic Parsing via Uncertainty

Zi Lin, Jeremiah Zhe Liu, Jingbo Shang

Translation Error Detection as Rationale Extraction

Marina Fomicheva, Lucia Specia, Nikolaos Aletras

On the data requirements of probing

Zining Zhu, Jixuan Wang, Bai Li, Frank Rudzicz

Should We Trust This Summary? Bayesian Abstractive Summarization to The Rescue

Alexios Gidiotis, Grigorios Tsoumakas

Exploring the Capacity of a Large-scale Masked Language Model to Recognize Grammatical Errors

Ryo Nagata, Manabu Kimura, Kazuaki Hanawa

Focus on the Action: Learning to Highlight and Summarize Jointly for Email To-Do Items Summarization

Kexun Zhang, Jiaao Chen, Diyi Yang

Structural Supervision for Word Alignment and Machine Translation

Lei Li, Kai Fan, Hongjia Li, Chun Yuan

Improving Zero-Shot Cross-lingual Transfer Between Closely Related Languages by Injecting Character-Level Noise

Noëmi Aepli, Rico Sennrich

Attention as Grounding: Exploring Textual and Cross-Modal Attention on Entities and Relations in Language-and-Vision Transformer

Nikolai Ilinykh, Simon Dobnik

CrossAligner & Co: Zero-Shot Transfer Methods for Task-Oriented Cross-lingual Natural Language Understanding

Milan Gritta, Ruoyu Hu, Ignacio Iacobacci

GCPG: A General Framework for Controllable Paraphrase Generation

Kexin Yang, Dayiheng Liu, Wenqiang Lei, Baosong Yang, Haibo Zhang

A Few-Shot Semantic Parser for Wizard-of-Oz Dialogues with the Precise ThingTalk Representation

Giovanni Campagna, Sina Semnani, Ryan Kearns, Lucas Jun Koba Sato, Silei Xu

Zero-Shot Dense Retrieval with Momentum Adversarial Domain Invariant Representations

Ji Xin, Chenyan Xiong, Ashwin Srinivasan, Ankita Sharma, Damien Jose

Interpreting the Robustness of Neural NLP Models to Textual Perturbations

Yunxiang Zhang, Liangming Pan, Samson Tan, Min-Yen Kan

Probing BERT’s priors with serial reproduction chains

Takateru Yamakoshi, Thomas Griffiths, Robert Hawkins

Attention Mechanism with Energy-Friendly Operations

Yu Wan, Baosong Yang, Dayiheng Liu, Rong Xiao, Derek Wong

Implicit Relation Linking for Question Answering over Knowledge Graph

Yao Zhao, Jiacheng Huang, Wei Hu, Qijin Chen, XiaoXia Qiu

E-KAR: A Benchmark for Rationalizing Natural Language Analogical Reasoning

Jiangjie Chen, Rui Xu, Ziquan Fu, Wei Shi, Zhongqiao Li

Unsupervised Chinese Word Segmentation with BERT Oriented Probing and Transformation

Wei Li, Yuhan Song, Qi Su, Yanqiu Shao

Word Segmentation by Separation Inference for East Asian Languages

Yu Tong, Jingzhi Guo, Jizhe Zhou, Ge Chen, Guokai Zheng

On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark

Hao Sun, Guangxuan Xu, Jiawen Deng, Jiale Cheng, Chujie Zheng

Rethinking Offensive Text Detection as a Multi-Hop Reasoning Problem

Qiang Zhang, Jason Naradowsky, Yusuke Miyao

Chinese Synesthesia Detection: New Dataset and Models

Xiaotong Jiang, Qingqing Zhao, Yunfei Long, Zhongqing Wang

Interpretable Research Replication Prediction via Variational Contextual Consistency Sentence Masking

Tianyi Luo, Rui Meng, Xin Wang, Yang Liu

Using NLP to quantify the environmental cost and diversity benefits of in-person NLP conferences

Piotr Przybyła, Matthew Shardlow

Unsupervised Preference-Aware Language Identification

Xingzhang Ren, Baosong Yang, Dayiheng Liu, Haibo Zhang, Xiaoyu Lv

Dialogue Summaries as Dialogue States (DS2), Template-Guided Summarization for Few-shot Dialogue State Tracking

Jamin Shin, Hangyeol Yu, Hyeongdon Moon, Andrea Madotto, Juneyoung Park

First the Worst: Finding Better Gender Translations During Beam Search

Danielle Saunders, Rosie Sallis, Bill Byrne

A Neural Pairwise Ranking Model for Readability Assessment

Justin Lee, Sowmya Vajjala

Probing Multilingual Cognate Prediction Models

Clémentine Fourrier, Benoît Sagot

Discontinuous Constituency and BERT: A Case Study of Dutch

Konstantinos Kogkalidis, Gijs Wijnholds

Prior Knowledge and Memory Enriched Transformer for Sign Language Translation

Tao Jin, Zhou Zhao, Meng Zhang, Xingshan Zeng

Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics

Daniel Deutsch, Dan Roth

ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference

Kai Hui, Honglei Zhuang, Tao Chen, Zhen Qin, Jing LU

Probing Factually Grounded Content Transfer with Factual Ablation

Peter West, Chris Quirk, Michel Galley, Yejin Choi

Local Structure Matters Most: Perturbation Study in NLU

Louis Clouatre, Prasanna Parthasarathi, Amal Zouaq, Sarath Chandar

Improving Candidate Retrieval with Entity Profile Generation for Wikidata Entity Linking

Tuan Lai, Heng Ji, ChengXiang Zhai

Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation

Kevin Yang, Olivia Deng, Charles Chen, Richard Shin, Subhro Roy

Platt-Bin: Efficient Posterior Calibrated Training for NLP Classifiers

Rishabh Singh, Shirin Goshtasbpour

Detection of Adversarial Examples in Text Classification: Benchmark and Baseline via Robust Density Estimation

KiYoon Yoo, Jangho Kim, Jiho Jang, Nojun Kwak

Modular Domain Adaptation

Junshen Chen, Dallas Card, Dan Jurafsky

Divide and Conquer: Text Semantic Matching with Disentangled Keywords and Intents

Yicheng Zou, Hongwei Liu, Tao Gui, Junzhe Wang, Qi Zhang

DARER: Dual-task Temporal Relational Recurrent Reasoning Network for Joint Dialog Sentiment Classification and Act Recognition

Bowen Xing, Ivor Tsang

Incorporating Dynamic Semantics into Pre-Trained Language Model for Aspect-based Sentiment Analysis

Kai Zhang, Kun Zhang, Mengdi Zhang, Hongke Zhao, Qi Liu

Improving the Adversarial Robustness of NLP Models by Information Bottleneck

Cenyuan Zhang, Xiang Zhou, Yixin Wan, Xiaoqing Zheng, Kai-Wei Chang

EICO: Improving Few-Shot Text Classification via Explicit and Implicit Consistency Regularization

lei zhao, Cheng Yao

Do Pre-trained Models Benefit Knowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach

Xin Lv, Yankai Lin, Yixin Cao, Lei Hou, Juanzi Li

LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrieval

Canwen Xu, Daya Guo, Nan Duan, Julian McAuley

Incremental Intent Detection for Medical Domain with Contrast Replay Networks

Guirong Bai, Shizhu He, Kang Liu, Jun Zhao

Rethinking Document-level Neural Machine Translation

Zewei Sun, Mingxuan Wang, Hao Zhou, Chengqi Zhao, Shujian Huang

HLDC: Hindi Legal Documents Corpus

Arnav Kapoor, Mudit Dhawan, Anmol Goel, Arjun T H, Akshala Bhatnagar

THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption

Tianyu Chen, Hangbo Bao, Shaohan Huang, Li Dong, Binxing Jiao

MERIt: Meta-Path Guided Contrastive Learning for Logical Reasoning

Fangkai Jiao, Yangyang Guo, Xuemeng Song, Liqiang Nie

What does it take to bake a cake? The RecipeRef corpus and anaphora resolution in procedural text

Biaoyan Fang, Timothy Baldwin, Karin Verspoor

Two Birds with One Stone: Unified Model Learning for Both Recall and Ranking in News Recommendation

Chuhan Wu, Fangzhao Wu, Tao Qi, Yongfeng Huang

Prompt Tuning for Discriminative Pre-trained Language Models

Yuan Yao, Bowen Dong, Ao Zhang, Zhengyan Zhang, Ruobing Xie

Improving Controllable Text Generation with Position-Aware Weighted Decoding

Yuxuan Gu, Xiaocheng Feng, Sicheng Ma, Jiaming Wu, Heng Gong

MetaWeighting: Learning to Weight Tasks in Multi-Task Learning

Yuren Mao, Zekai Wang, Weiwei Liu, Xuemin Lin, Pengtao Xie

Comprehensive Multi-Modal Interactions for Referring Image Segmentation

Kanishk Jain, Vineet Gandhi

Event Transition Planning for Open-ended Text Generation

Qintong Li, Piji Li, Wei Bi, Zhaochun Ren, Yuxuan Lai

Consistent Representation Learning for Continual Relation Extraction

Kang Zhao, Hua Xu, Jiangong Yang, Kai Gao

Aligned Weight Regularizers for Pruning Pretrained Neural Networks

James O’ Neill, Sourav Dutta, Haytham Assem

Cross-Lingual UMLS Named Entity Linking using UMLS Dictionary Fine-Tuning

Rina Galperin, Shachar Schnapp, Michael Elhadad

CUE Vectors: Modular Training of Language Models Conditioned on Diverse Contextual Signals

Scott Novotney, Sreeparna Mukherjee, Zeeshan Ahmed, Andreas Stolcke

From Stance to Concern: Adaptation of Propositional Analysis to New Tasks and Domains

Brodie Mather, Bonnie Dorr, Adam Dalton, William de Beaumont, Owen Rambow

A Natural Diet: Towards Improving Naturalness of Machine Translation Output

Markus Freitag, David Vilar, David Grangier, Colin Cherry, George Foster

IsoScore: Measuring the Uniformity of Embedding Space Utilization

William Rudman, Nate Gillman, Taylor Rayne, Carsten Eickhoff

Comparative Opinion Summarization via Collaborative Decoding

Hayate Iso, Xiaolan Wang, Stefanos Angelidis, Yoshihiko Suhara

Controlling the Focus of Pretrained Language Generation Models

Jiabao Ji, Yoon Kim, James Glass, Tianxing He

Bridging Pre-trained Language Models and Hand-crafted Features for Unsupervised POS Tagging

Houquan Zhou, Yang Li, Zhenghua Li, Min Zhang

Word-level Perturbation Considering Word Length and Compositional Subwords

Tatsuya Hiraoka, Sho Takase, Kei Uchiumi, Atsushi Keyaki, Naoaki Okazaki

One Agent To Rule Them All: Towards Multi-agent Conversational AI

Christopher Clarke, Joseph Peper, Karthik Krishnamurthy, Walter Talamonti, Kevin Leach

Encoding and Fusing Semantic Connection and Linguistic Evidence for Implicit Discourse Relation Recognition

Wei Xiang, Bang Wang, Lu Dai, Yijun Mo

Leveraging Knowledge in Multilingual Commonsense Reasoning

Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun

Type-Driven Multi-Turn Corrections for Grammatical Error Correction

Shaopeng Lai, Qingyu Zhou, Jiali Zeng, Zhongli Li, CHAO LI

XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding

Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu

The Past Mistake is the Future Wisdom: Error-driven Contrastive Probability Optimization for Chinese Spell Checking

Yinghui Li, Qingyu Zhou, Yangning Li, Zhongli Li, Ruiyang Liu

UNIMO-2: End-to-End Unified Vision-Language Grounded Learning

Wei Li, Can Gao, Guocheng Niu, Xinyan Xiao, Hao Liu

Fusing Heterogeneous Factors with Triaffine Mechanism for Nested Named Entity Recognition

Zheng Yuan, Chuanqi Tan, Songfang Huang, Fei Huang

The Inefficiency of Language Models in Scholarly Retrieval: An Experimental Walk-through

Shruti Singh, Mayank Singh

Exploring the Impact of Negative Samples of Contrastive Learning: A Case Study of Sentence Embedding

Rui Cao, Yihao Wang, Yuxin Liang, Ling Gao, Jie Zheng

Task-guided Disentangled Tuning for Pretrained Language Models

Jiali Zeng, Yufan Jiang, Shuangzhi Wu, Yongjing Yin, Mu Li

Improving Robustness of Language Models from a Geometry-aware Perspective

Bin Zhu, Zhaoquan Gu, Le Wang, Jinyin Chen, Qi Xuan

Using Pre-Trained Language Models for Producing Counter Narratives Against Hate Speech: a Comparative Study

Serra Sinem Tekiroglu, Helena Bonaldi, Margherita Fanton, Marco Guerini

AMR-DA: Data Augmentation by Abstract Meaning Representation

Ziyi Shou, Yuxin Jiang, Fangzhen Lin