Pretraining

ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts EMNLP 2022 AudioTagging Done Right: 2nd comparison of deep learning methods for environmental sound classification Interspeech 2022 A Unified Representation and a Decoupled Deep Learning Architecture for Argumentation Mining of Students’ Persuasive Essays COLING 2022 Automatic Prosody Annotation with Pre-Trained Text-Speech Model Interspeech 2022 A Vietnamese-English Neural Machine Translation System Interspeech 2022 BatchFormer: Learning To Explore Sample Relationships for Robust Representation Learning CVPR 2022 BEVT: BERT Pretraining of Video Transformers CVPR 2022 Biomedical NER for the Enterprise with Distillated BERN2 and the Kazu Framework EMNLP 2022 Bi-SimCut: A Simple Strategy for Boosting Neural Machine Translation NAACL 2022 BLOX: Macro Neural Architecture Search Benchmark and Algorithms NeurIPS 2022 Boosting Deep CTR Prediction with a Plug-and-Play Pre-trainer for News Recommendation COLING 2022 Bootstrapping ViTs: Towards Liberating Vision Transformers From Pre-Training CVPR 2022 CAISA@SMM4H’22: Robust Cross-Lingual Detection of Disease Mentions on Social Media with Adversarial Methods COLING 2022 Can Vision Transformers Learn without Natural Images? AAAI 2022 Choose Your Lenses: Flaws in Gender Bias Evaluation NAACL 2022 CIC NLP at SMM4H 2022: a BERT-based approach for classification of social media forum posts COLING 2022 CINS: Comprehensive Instruction for Few-Shot Learning in Task-Oriented Dialog Systems AAAI 2022 ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer for Event-Centric Generation and Classification ACL 2022 CNLP-NITS-PP at WANLP 2022 Shared Task: Propaganda Detection in Arabic using Data Augmentation and AraBERT Pre-trained Model EMNLP 2022 CODE-MVP: Learning to Represent Source Code from Multiple Views with Contrastive Pre-Training NAACL 2022 CodeRetriever: A Large Scale Contrastive Pre-Training Method for Code Search EMNLP 2022 CogBERT: Cognition-Guided Pre-trained Language Models COLING 2022 CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers NeurIPS 2022 COLD: A Benchmark for Chinese Offensive Language Detection EMNLP 2022 Collective Relevance Labeling for Passage Retrieval NAACL 2022