Foundation Models

MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detection SemEval 2021 Model-based analysis of brain activity reveals the hierarchy of language in 305 subjects EMNLP 2021 MSA Transformer ICML 2021 mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer NAACL 2021 Multi-Person 3D Motion Prediction with Multi-Range Transformers NeurIPS 2021 Multi-view Subword Regularization NAACL 2021 Muppet: Massive Multi-task Representations with Pre-Finetuning EMNLP 2021 NAS-HPO-Bench-II: A Benchmark Dataset on Joint Optimization of Convolutional Neural Network Architecture and Training Hyperparameters ACML 2021 Neural Analysis and Synthesis: Reconstructing Speech from Self-Supervised Representations NeurIPS 2021 Neural Architecture Search With Random Labels CVPR 2021 Neuro-Symbolic Techniques for Description Logic Reasoning (Student Abstract) AAAI 2021 NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformer SemEval 2021 Nonsmooth Implicit Differentiation for Machine-Learning and Optimization NeurIPS 2021 Offline Reinforcement Learning as One Big Sequence Modeling Problem NeurIPS 2021 Offline Reinforcement Learning from Human Feedback in Real-World Sequence-to-Sequence Tasks ACL 2021 ONE: Toward ONE model, ONE algorithm, ONE corpus dedicated to sentiment analysis of Arabic/Arabizi and its dialects EACL 2021 Online Learning Of Neural Computations From Sparse Temporal Feedback NeurIPS 2021 On the Generation of Medical Dialogs for COVID-19 ACL 2021 On the Out-of-distribution Generalization of Probabilistic Image Modelling NeurIPS 2021 Paint Transformer: Feed Forward Neural Painting With Stroke Prediction ICCV 2021 Pathwise Conditioning of Gaussian Processes JMLR 2021 PLUR: A Unifying, Graph-Based View of Program Learning, Understanding, and Repair NeurIPS 2021 Predator: Registration of 3D Point Clouds With Low Overlap CVPR 2021 Prediction of Landfall Intensity, Location, and Time of a Tropical Cyclone AAAI 2021 Pre-training Methods for Neural Machine Translation ACL 2021