conftrace_

ensemble distillation

16 papers

Explore in graph

Co-occurring keywords

knowledge distillation (3725) federated learning (1333) ensemble learning (1274) model compression (3302) encoder-decoder architecture (380) model distillation (108) model calibration (232) contrastive learning (4032) communication bottleneck (4) deep ensemble (52)

Papers

Credal Ensemble Distillation for Uncertainty Quantification AAAI 2026
BabyLlama-2: Ensemble-Distilled Models Consistently Outperform Teachers With Limited Data CONLL 2024
Calibrated One Round Federated Learning with Bayesian Inference in the Predictive Space AAAI 2024
Federated Ensemble-Directed Offline Reinforcement Learning NIPS 2024
Towards Understanding Ensemble Distillation in Federated Learning ICML 2023
Self-Decoupling and Ensemble Distillation for Efficient Segmentation AAAI 2023
An Ensemble Distillation Framework for Sentence Embeddings with Multilingual Round-Trip Translation AAAI 2023
Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining ICML 2023
Maximum Bayes Smatch Ensemble Distillation for AMR Parsing NAACL 2022
Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation ICML 2022
Cosine Model Watermarking against Ensemble Distillation AAAI 2022
Ensemble Attention Distillation for Privacy-Preserving Federated Learning ICCV 2021
Scaling Ensemble Distribution Distillation to Many Classes with Proxy Targets NIPS 2021
FedED: Federated Learning via Ensemble Distillation for Medical Relation Extraction EMNLP 2020
Ensemble Distillation for Structured Prediction: Calibrated, Accurate, Fast—Choose Three EMNLP 2020
Fast, Accurate, and Simple Models for Tabular Data via Augmented Distillation NIPS 2020