Foundation Models

AstBERT: Enabling Language Model for Financial Code Understanding with Abstract Syntax Trees EMNLP 2022 A Unified Hard-Constraint Framework for Solving Geometrically Complex PDEs NeurIPS 2022 Autoformalization with Large Language Models NeurIPS 2022 BanglaParaphrase: A High-Quality Bangla Paraphrase Dataset AACL 2022 Billion-Scale Pretraining With Vision Transformers for Multi-Task Visual Representations WACV 2022 Black-Box Tuning for Language-Model-as-a-Service ICML 2022 BRIO: Bringing Order to Abstractive Summarization ACL 2022 C2FAR: Coarse-to-Fine Autoregressive Networks for Precise Probabilistic Forecasting NeurIPS 2022 Can Foundation Models Perform Zero-Shot Task Specification For Robot Manipulation? L4DC 2022 CascadeXML: Rethinking Transformers for End-to-end Multi-resolution Training in Extreme Multi-label Classification NeurIPS 2022 CERT: Continual Pre-training on Sketches for Library-oriented Code Generation IJCAI 2022 Challenges in including extra-linguistic context in pre-trained language models ACL 2022 Clinical-BERT: Vision-Language Pre-training for Radiograph Diagnosis and Reports Generation AAAI 2022 CodeTrek: Flexible Modeling of Code using an Extensible Relational Representation ICLR 2022 Combine to Describe: Evaluating Compositional Generalization in Image Captioning ACL 2022 Composing Partial Differential Equations with Physics-Aware Neural Networks ICML 2022 Conditional Prompt Learning for Vision-Language Models CVPR 2022 Context Limitations Make Neural Language Models More Human-Like EMNLP 2022 Controlled Language Generation for Language Learning Items EMNLP 2022 Conversational Semantic Role Labeling with Predicate-Oriented Latent Graph IJCAI 2022 Could Giant Pre-trained Image Models Extract Universal Representations? NeurIPS 2022 CounterGeDi: A Controllable Approach to Generate Polite, Detoxified and Emotional Counterspeech IJCAI 2022 Cree Corpus: A Collection of nêhiyawêwin Resources ACL 2022 Cross-Task Generalization via Natural Language Crowdsourcing Instructions ACL 2022 CULG: Commercial Universal Language Generation NAACL 2022