Pretraining

PLOG: Table-to-Logic Pretraining for Logical Table-to-Text Generation EMNLP 2022 Plugging a neural phoneme recognizer into a simple language model: a workflow for low-resource setting Interspeech 2022 Point-BERT: Pre-Training 3D Point Cloud Transformers With Masked Point Modeling CVPR 2022 Point Cloud Generation with Continuous Conditioning AISTATS 2022 PPT: Pre-trained Prompt Tuning for Few-shot Learning ACL 2022 Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation? IJCAI 2022 Pretrained Models for Multilingual Federated Learning NAACL 2022 Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation? ACL 2022 Pre-trained Speech Representations as Feature Extractors for Speech Quality Assessment in Online Conferencing Applications Interspeech 2022 Pre-training Language Models with Deterministic Factual Knowledge EMNLP 2022 Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection EMNLP 2022 PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization ACL 2022 PRINCE: Prefix-Masked Decoding for Knowledge Enhanced Sequence-to-Sequence Pre-Training EMNLP 2022 Procedural Image Programs for Representation Learning NeurIPS 2022 🏘️ ProcTHOR: Large-Scale Embodied AI Using Procedural Generation NeurIPS 2022 Progressive Class Semantic Matching for Semi-supervised Text Classification NAACL 2022 Promoting Pre-trained LM with Linguistic Features on Automatic Readability Assessment AACL 2022 PromptGen: Automatically Generate Prompts using Generative Models NAACL 2022 Pronunciation Dictionary-Free Multilingual Speech Synthesis by Combining Unsupervised and Supervised Phonetic Representations Interspeech 2022 ProQA: Structural Prompt-based Pre-training for Unified Question Answering NAACL 2022 PyramidCLIP: Hierarchical Feature Alignment for Vision-language Model Pretraining NeurIPS 2022 R2D2 at SemEval-2022 Task 5: Attention is only as good as its Values! A multimodal system for identifying misogynist memes SemEval 2022 RACE: Retrieval-augmented Commit Message Generation EMNLP 2022 Ranking and Tuning Pre-trained Models: A New Paradigm for Exploiting Model Hubs JMLR 2022 Real-Time Hyperspectral Imaging in Hardware via Trained Metasurface Encoders CVPR 2022