Knowledge Distillation

RaFe: Ranking Feedback Improves Query Rewriting for RAG EMNLP 2024 RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation EMNLP 2024 Ranking Distillation for Open-Ended Video Question Answering with Insufficient Labels CVPR 2024 RDproj at SemEval-2024 Task 4: An Ensemble Learning Approach for Multilingual Detection of Persuasion Techniques in Memes SemEval 2024 Reducing hallucination in structured outputs via Retrieval-Augmented Generation NAACL 2024 Reducing Spatial Fitting Error in Distillation of Denoising Diffusion Models AAAI 2024 Reference Trustable Decoding: A Training-Free Augmentation Paradigm for Large Language Models NeurIPS 2024 Reinforced Cross-Domain Knowledge Distillation on Time Series Data NeurIPS 2024 Resource-Aware Federated Self-Supervised Learning with Global Class Representations NeurIPS 2024 Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers (Student Abstract) AAAI 2024 Rethinking Centered Kernel Alignment in Knowledge Distillation IJCAI 2024 Rethinking Knowledge Distillation With Raw Features for Semantic Segmentation WACV 2024 Rethinking Reverse Distillation for Multi-Modal Anomaly Detection AAAI 2024 Retrieval Augmented Spelling Correction for E-Commerce Applications EMNLP 2024 Revealing the Two Sides of Data Augmentation: An Asymmetric Distillation-based Win-Win Solution for Open-Set Recognition IJCAI 2024 Reverse Knowledge Distillation: Training a Large Model Using a Small One for Retinal Image Matching on Limited Data WACV 2024 Revisiting Knowledge Distillation for Autoregressive Language Models ACL 2024 Robust Distillation via Untargeted and Targeted Intermediate Adversarial Samples CVPR 2024 RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning EMNLP 2024 RRADistill: Distilling LLMs’ Passage Ranking Ability for Long-Tail Queries Document Re-Ranking on a Search Engine EMNLP 2024 S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity NeurIPS 2024 S2HPruner: Soft-to-Hard Distillation Bridges the Discretization Gap in Pruning NeurIPS 2024 SAM-Guided Masked Token Prediction for 3D Scene Understanding NeurIPS 2024 SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models ACL 2024 Scalable and Domain-General Abstractive Proposition Segmentation EMNLP 2024