← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

APGN: Adversarial and Parameter Generation Networks for Multi-Source Cross-Domain Dependency Parsing EMNLP 2021
BERT might be Overkill: A Tiny but Effective Biomedical Entity Linker based on Residual Convolutional Neural Networks EMNLP 2021
LayoutReader: Pre-training of Text and Layout for Reading Order Detection EMNLP 2021
DyLex: Incorporating Dynamic Lexicons into BERT for Sequence Labeling EMNLP 2021
AttentionRank: Unsupervised Keyphrase Extraction using Self and Cross Attentions EMNLP 2021
DepthInSpace: Exploitation and Fusion of Multiple Video Frames for Structured-Light Depth Estimation ICCV 2021
Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone INTERSPEECH 2021
Language Recognition Based on Unsupervised Pretrained Models INTERSPEECH 2021
StereOBJ-1M: Large-Scale Stereo Image Dataset for 6D Object Pose Estimation ICCV 2021
Is Pseudo-Lidar Needed for Monocular 3D Object Detection? ICCV 2021
Cross-lingual Visual Pre-training for Multimodal Machine Translation EACL 2021
Phrase Break Prediction with Bidirectional Encoder Representations in Japanese Text-to-Speech Synthesis INTERSPEECH 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision ICML 2021
Phoneme Duration Modeling Using Speech Rhythm-Based Speaker Embeddings for Multi-Speaker Speech Synthesis INTERSPEECH 2021
Adaptive Text to Speech for Spontaneous Style INTERSPEECH 2021
ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases ICML 2021
An Improved Wav2Vec 2.0 Pre-Training Approach Using Enhanced Local Dependency Modeling for Speech Recognition INTERSPEECH 2021
Pre-Training for Spoken Language Understanding with Joint Textual and Phonetic Representation Learning INTERSPEECH 2021
Psycholinguistic Tripartite Graph Network for Personality Detection IJCNLP 2021
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization IJCNLP 2021
LeCun at SemEval-2021 Task 6: Detecting Persuasion Techniques in Text Using Ensembled Pretrained Transformers and Data Augmentation SEMEVAL 2021
Binaural Audio-Visual Localization AAAI 2021
Improving Perceptual Quality by Phone-Fortified Perceptual Loss Using Wasserstein Distance for Speech Enhancement INTERSPEECH 2021
SkoltechNLP at SemEval-2021 Task 5: Leveraging Sentence-level Pre-training for Toxic Span Detection SEMEVAL 2021
Learning Anchored Unsigned Distance Functions With Gradient Direction Alignment for Single-View Garment Reconstruction ICCV 2021