← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Improving Transformer-Based Speech Recognition with Unsupervised Pre-Training and Multi-Task Semantic Knowledge Learning INTERSPEECH 2020
Streaming On-Device End-to-End ASR System for Privacy-Sensitive Voice-Typing INTERSPEECH 2020
Attentron: Few-Shot Text-to-Speech Utilizing Attention-Based Variable-Length Embedding INTERSPEECH 2020
Lightweight End-to-End Speech Recognition from Raw Audio Data Using Sinc-Convolutions INTERSPEECH 2020
A Deep 2D Convolutional Network for Waveform-Based Speech Recognition INTERSPEECH 2020
Multi-Encoder-Decoder Transformer for Code-Switching Speech Recognition INTERSPEECH 2020
Semantic Mask for Transformer Based End-to-End Speech Recognition INTERSPEECH 2020
ASAPP-ASR: Multistream CNN and Self-Attentive SRU for SOTA Speech Recognition INTERSPEECH 2020
Span-ConveRT: Few-shot Span Extraction for Dialog with Pretrained Conversational Representations ACL 2020
Representations of Syntax [MASK] Useful: Effects of Constituency and Dependency Structure in Recursive LSTMs ACL 2020
How Can We Accelerate Progress Towards Human-like Linguistic Generalization? ACL 2020
Implicit Discourse Relation Classification: We Need to Talk about Evaluation ACL 2020
Should You Fine-Tune BERT for Automated Essay Scoring? ACL 2020
Exploring the Limits of Simple Learners in Knowledge Distillation for Document Classification with DocBERT ACL 2020
A Simple and Effective Dependency Parser for Telugu ACL 2020
Exploring Neural Architectures And Techniques For Typologically Diverse Morphological Inflection ACL 2020
Roles and Utilization of Attention Heads in Transformer-based Neural Language Models ACL 2020
Efficient Intent Detection with Dual Sentence Encoders ACL 2020
LAST at SemEval-2020 Task 10: Finding Tokens to Emphasise in Short Written Texts with Precomputed Embedding Models and LightGBM SEMEVAL 2020
Extending Unsupervised Neural Image Compression With Supervised Multitask Learning MIDL 2020
The SOFC-Exp Corpus and Neural Approaches to Information Extraction in the Materials Science Domain ACL 2020
TaPas: Weakly Supervised Table Parsing via Pre-training ACL 2020
CamemBERT: a Tasty French Language Model ACL 2020
Speech Representation Learning for Emotion Recognition Using End-to-End ASR with Factorized Adaptation INTERSPEECH 2020
Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-Training CVPR 2020