Md Akmal Haidar
4 papers · 2021–2022 · 4 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓
π
Conference Polyglot
(4)
π
Interdisciplinary Bridge
πΊοΈ
Taxonomy Completionist
(14)
π§
Keyword Pioneer
π
Cross-Pollinator
(15)
Conferences
COLING (1)
EMNLP (1)
INTERSPEECH (1)
NAACL (1)
Top co-authors
Keywords
knowledge distillation
(4)
intermediate layer
(2)
online learning
(1)
attention mechanism
(1)
data augmentation
(1)
masked language model
(1)
automatic speech recognition
(1)
adversarial training
(1)
pre-trained language model
(1)
student model
(1)
teacher model
(1)
intermediate layer distillation
(1)
neural network
(1)
student teacher
(1)
chunked attention
(1)
model compression
(1)
layer mapping
(1)
contrastive learning
(1)
Papers
CILDA: Contrastive Data Augmentation Using Intermediate Layer Knowledge Distillation
COLING 2022
Conformer with dual-mode chunked attention for joint online and offline ASR
INTERSPEECH 2022
RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation
NAACL 2022
Universal-KD: Attention-based Output-Grounded Intermediate Layer Knowledge Distillation
EMNLP 2021