conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models EMNLP 2022
Can Current Explainability Help Provide References in Clinical Notes to Support Humans Annotate Medical Codes? EMNLP 2022
SMASH: Improving SMAll Language Models’ Few-SHot Ability with Prompt-Based Distillation EMNLP 2022
ConGen: Unsupervised Control and Generalization Distillation For Sentence Representation EMNLP 2022
Learn What Is Possible, Then Choose What Is Best: Disentangling One-To-Many Relations in Language Through Text-based Games EMNLP 2022
Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models EMNLP 2022
Semi-Supervised Lifelong Language Learning EMNLP 2022
Bitext Mining Using Distilled Sentence Representations for Low-Resource Languages EMNLP 2022
Self-Distillation with Meta Learning for Knowledge Graph Completion EMNLP 2022
Knowledge Stimulated Contrastive Prompting for Low-Resource Stance Detection EMNLP 2022
Prompt Conditioned VAE: Enhancing Generative Replay for Lifelong Learning in Task-Oriented Dialogue EMNLP 2022
Adaptive Label Smoothing with Self-Knowledge in Natural Language Generation EMNLP 2022
Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders EMNLP 2022
ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networks EMNLP 2022
Transn’s Submissions to the WMT22 Translation Suggestion Task EMNLP 2022
Too Brittle to Touch: Comparing the Stability of Quantization and Distillation towards Developing Low-Resource MT Models EMNLP 2022
The RoyalFlush System for the WMT 2022 Efficiency Task EMNLP 2022
Edinburgh’s Submission to the WMT 2022 Efficiency Task EMNLP 2022
The NiuTrans Machine Translation Systems for WMT22 EMNLP 2022
Samsung R&D Institute Poland Participation in WMT 2022 EMNLP 2022
An Efficient Active Learning Pipeline for Legal Text Classification EMNLP 2022
How Can a Teacher Make Learning From Sparse Data Softer? Application to Business Relation Extraction EMNLP 2022
BMCook: A Task-agnostic Compression Toolkit for Big Models EMNLP 2022
Hard Gate Knowledge Distillation - Leverage Calibration for Robust and Reliable Language Model EMNLP 2022
Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillation EMNLP 2022