conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Digging out Discrimination Information from Generated Samples for Robust Visual Question Answering ACL 2023
Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented Dialog ACL 2023
BERM: Training the Balanced and Extractable Representation for Matching to Improve Generalization Ability of Dense Retrieval ACL 2023
Rehearsal-free Continual Language Learning via Efficient Parameter Isolation ACL 2023
Incorporating Graph Information in Transformer-based AMR Parsing ACL 2023
SANTA: Separate Strategies for Inaccurate and Incomplete Annotation Noise in Distantly-Supervised Named Entity Recognition ACL 2023
Enhancing Spanish-Quechua Machine Translation with Pre-Trained Models and Diverse Data Sources: LCT-EHU at AmericasNLP Shared Task ACL 2023
How Much do Knowledge Graphs Impact Transformer Models for Extracting Biomedical Events? ACL 2023
Large Language Models as Instructors: A Study on Multilingual Clinical Entity Extraction ACL 2023
BIOptimus: Pre-training an Optimal Biomedical Language Model with Curriculum Learning for Named Entity Recognition ACL 2023
IAG: Induction-Augmented Generation Framework for Answering Reasoning Questions EMNLP 2023
Towards Robust Pruning: An Adaptive Knowledge-Retention Pruning Strategy for Language Models EMNLP 2023
Democratizing Reasoning Ability: Tailored Learning from Large Language Model EMNLP 2023
TrueTeacher: Learning Factual Consistency Evaluation with Large Language Models EMNLP 2023
Understanding the Effect of Model Compression on Social Bias in Large Language Models EMNLP 2023
Exploring All-In-One Knowledge Distillation Framework for Neural Machine Translation EMNLP 2023
Knowledge Distillation ≈ Label Smoothing: Fact or Fallacy? EMNLP 2023
PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillation EMNLP 2023
PRCA: Fitting Black-Box Large Language Models for Retrieval Question Answering via Pluggable Reward-Driven Contextual Adapter EMNLP 2023
Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents EMNLP 2023
Personalized Distillation: Empowering Open-Sourced LLMs with Adaptive Learning for Code Generation EMNLP 2023
CaseEncoder: A Knowledge-enhanced Pre-trained Model for Legal Case Encoding EMNLP 2023
Generating Data for Symbolic Language with Large Language Models EMNLP 2023
FedID: Federated Interactive Distillation for Large-Scale Pretraining Language Models EMNLP 2023
CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model EMNLP 2023