Foundation Models

Transformers meet Stochastic Block Models: Attention with Data-Adaptive Sparsity and Cost NeurIPS 2022 Transformer with Memory Replay AAAI 2022 TSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question Answering EMNLP 2022 Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills ACL 2022 UKPGAN: A General Self-Supervised Keypoint Detector CVPR 2022 Understanding Hyperdimensional Computing for Parallel Single-Pass Learning NeurIPS 2022 UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models EMNLP 2022 Unifying and Boosting Gradient-Based Training-Free Neural Architecture Search NeurIPS 2022 Uni-Perceiver: Pre-Training Unified Architecture for Generic Perception for Zero-Shot and Few-Shot Tasks CVPR 2022 Validating Causal Inference Methods ICML 2022 ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation NeurIPS 2022 WavPrompt: Towards Few-Shot Spoken Language Understanding with Frozen Language Models Interspeech 2022 WAX: A New Dataset for Word Association eXplanations AACL 2022 What do Large Language Models Learn about Scripts? NAACL 2022 What do Large Language Models Learn beyond Language? EMNLP 2022 What Has Been Enhanced in my Knowledge-Enhanced Language Model? EMNLP 2022 Whitening Convergence Rate of Coupling-based Normalizing Flows NeurIPS 2022 Who is GPT-3? An exploration of personality, values and demographics EMNLP 2022 Word Order Matters When You Increase Masking EMNLP 2022 Word-order Typology in Multilingual BERT: A Case Study in Subordinate-Clause Detection NAACL 2022 X-PuDu at SemEval-2022 Task 7: A Replaced Token Detection Task Pre-trained Model with Pattern-aware Ensembling for Identifying Plausible Clarifications SemEval 2022 Zero-Shot Learners for Natural Language Understanding via a Unified Multiple Choice Perspective EMNLP 2022 Zero-Shot Reward Specification via Grounded Natural Language ICML 2022 Adaptive Residue-wise Profile Fusion for Low Homologous Protein Secondary Structure Prediction Using External Knowledge IJCAI 2021 A Design Space Study for LISTA and Beyond ICLR 2021