Large Language Models

What do tokens know about their characters and how do they know it? NAACL 2022 What do Toothbrushes do in the Kitchen? How Transformers Think our World is Structured NAACL 2022 What GPT Knows About Who is Who ACL 2022 What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization? ICML 2022 What Language Model to Train if You Have One Million GPU Hours? EMNLP 2022 What Makes Data-to-Text Generation Hard for Pretrained Language Models? EMNLP 2022 When Cantonese NLP Meets Pre-training: Progress and Challenges AACL 2022 When FLUE Meets FLANG: Benchmarks and Large Pretrained Language Model for Financial Domain EMNLP 2022 Where Does Linguistic Information Emerge in Neural Language Models? Measuring Gains and Contributions across Layers COLING 2022 White-box Testing of NLP models with Mask Neuron Coverage NAACL 2022 Who is GPT-3? An exploration of personality, values and demographics EMNLP 2022 Who Says Elephants Can’t Run: Bringing Large Scale MoE Models into Cloud Scale Production EMNLP 2022 Will It Blend? Mixing Training Paradigms & Prompting for Argument Quality Prediction COLING 2022 Word Order Does Matter and Shuffled Language Models Know It ACL 2022 XDBERT: Distilling Visual Information to BERT from Cross-Modal Systems to Improve Language Understanding ACL 2022 XLM-E: Cross-lingual Language Model Pre-training via ELECTRA ACL 2022 XLM-K: Improving Cross-Lingual Language Model Pre-training with Multilingual Knowledge AAAI 2022 You Are My Type! Type Embeddings for Pre-trained Language Models EMNLP 2022 You reap what you sow: On the Challenges of Bias Evaluation Under Multilingual Settings ACL 2022 You Truly Understand What I Need : Intellectual and Friendly Dialog Agents grounding Persona and Knowledge EMNLP 2022 ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers NeurIPS 2022 Zero-Shot Aspect-Based Scientific Document Summarization using Self-Supervised Pre-training ACL 2022 Zero-Shot Commonsense Question Answering with Cloze Translation and Consistency Optimization AAAI 2022 Zero-Shot Video Question Answering via Frozen Bidirectional Language Models NeurIPS 2022 ZhichunRoad at SemEval-2022 Task 2: Adversarial Training and Contrastive Learning for Multiword Representations SemEval 2022