Knowledge Distillation

FedDGL: Federated Dynamic Graph Learning for Temporal Evolution and Data Heterogeneity ACML 2024 Federated Learning via Input-Output Collaborative Distillation AAAI 2024 Federated Learning with Extremely Noisy Clients via Negative Distillation AAAI 2024 FedGMKD: An Efficient Prototype Federated Learning Framework through Knowledge Distillation and Discrepancy-Aware Aggregation NeurIPS 2024 FedPFT: Federated Proxy Fine-Tuning of Foundation Models IJCAI 2024 FedTAD: Topology-aware Data-free Knowledge Distillation for Subgraph Federated Learning IJCAI 2024 Fine-Grained Distillation for Long Document Retrieval AAAI 2024 Fine-Grained Knowledge Selection and Restoration for Non-exemplar Class Incremental Learning AAAI 2024 Fine-Tuning is Fine, if Calibrated NeurIPS 2024 FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation EMNLP 2024 Flipped Classroom: Aligning Teacher Attention with Student in Generalized Category Discovery NeurIPS 2024 F-MALLOC: Feed-forward Memory Allocation for Continual Learning in Neural Machine Translation NAACL 2024 FM-Delta: Lossless Compression for Storing Massive Fine-tuned Foundation Models NeurIPS 2024 For the Misgendered Chinese in Gender Bias Research: Multi-Task Learning with Knowledge Distillation for Pinyin Name Gender Prediction IJCAI 2024 FouRA: Fourier Low-Rank Adaptation NeurIPS 2024 FREE: Faster and Better Data-Free Meta-Learning CVPR 2024 FreeKD: Knowledge Distillation via Semantic Frequency Prompt CVPR 2024 Frequency Attention for Knowledge Distillation WACV 2024 Frequency-mix Knowledge Distillation for Fake Speech Detection Interspeech 2024 From Bottom to Top: Extending the Potential of Parameter Efficient Fine-Tuning EMNLP 2024 From Coarse to Fine: A Distillation Method for Fine-Grained Emotion-Causal Span Pair Extraction in Conversation AAAI 2024 From Instance Training to Instruction Learning: Task Adapters Generation from Instructions NeurIPS 2024 FROSTER: Frozen CLIP is A Strong Teacher for Open-Vocabulary Action Recognition ICLR 2024 FRVA: Fact-Retrieval and Verification Augmented Entailment Tree Generation for Explainable Question Answering ACL 2024 Further Compressing Distilled Language Models via Frequency-aware Partial Sparse Coding of Embeddings CoNLL 2024