← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Revisiting the Transferability of Supervised Pretraining: An MLP Perspective CVPR 2022
Real-Time Hyperspectral Imaging in Hardware via Trained Metasurface Encoders CVPR 2022
Scaling Vision Transformers CVPR 2022
Continued Pretraining for Better Zero- and Few-Shot Promptability EMNLP 2022
A Vietnamese-English Neural Machine Translation System INTERSPEECH 2022
🏘️ ProcTHOR: Large-Scale Embodied AI Using Procedural Generation NIPS 2022
CNLP-NITS-PP at WANLP 2022 Shared Task: Propaganda Detection in Arabic using Data Augmentation and AraBERT Pre-trained Model EMNLP 2022
Momentum Contrastive Pre-training for Question Answering EMNLP 2022
PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training EMNLP 2022
PLOG: Table-to-Logic Pretraining for Logical Table-to-Text Generation EMNLP 2022
InforMask: Unsupervised Informative Masking for Language Model Pretraining EMNLP 2022
ExpertPLM: Pre-training Expert Representation for Expert Finding EMNLP 2022
STAR: SQL Guided Pre-Training for Context-dependent Text-to-SQL Parsing EMNLP 2022
IITR CodeBusters at SemEval-2022 Task 5: Misogyny Identification using Transformers NAACL 2022
Romanian Language Translation in the RELATE Platform COLING 2022
On the Role of Pre-trained Language Models in Word Ordering: A Case Study with BART COLING 2022
LILE: Look In-Depth before Looking Elsewhere – A Dual Attention Network using Transformers for Cross-Modal Information Retrieval in Histopathology Archives MIDL 2022
Explainability Guided COVID-19 Detection in CT Scans MIDL 2022
DENTRA: Denoising and Translation Pre-training for Multilingual Machine Translation EMNLP 2022
Pronunciation Dictionary-Free Multilingual Speech Synthesis by Combining Unsupervised and Supervised Phonetic Representations INTERSPEECH 2022
Towards high-fidelity singing voice conversion with acoustic reference and contrastive predictive coding INTERSPEECH 2022
The ZevoMOS entry to VoiceMOS Challenge 2022 INTERSPEECH 2022
The THUEE System Description for the IARPA OpenASR21 Challenge INTERSPEECH 2022
TVLT: Textless Vision-Language Transformer NIPS 2022
Spatiotemporal Initialization for 3D CNNs With Generated Motion Patterns WACV 2022