← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks NIPS 2024
Visual Perception by Large Language Model’s Weights NIPS 2024
Compact Language Models via Pruning and Knowledge Distillation NIPS 2024
Expert-level protocol translation for self-driving labs NIPS 2024
SimVG: A Simple Framework for Visual Grounding with Decoupled Multi-modal Fusion NIPS 2024
VeXKD: The Versatile Integration of Cross-Modal Fusion and Knowledge Distillation for 3D Perception NIPS 2024
RA2FD: Distilling Faithfulness into Efficient Dialogue Systems EMNLP 2024
SlimSAM: 0.1% Data Makes Segment Anything Slim NIPS 2024
D3still: Decoupled Differential Distillation for Asymmetric Image Retrieval CVPR 2024
WebUOT-1M: Advancing Deep Underwater Object Tracking with A Million-Scale Benchmark NIPS 2024
KnowledgeSG: Privacy-Preserving Synthetic Text Generation with Knowledge Distillation from Server EMNLP 2024
Model LEGO: Creating Models Like Disassembling and Assembling Building Blocks NIPS 2024
Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models NIPS 2024
Towards Diverse Device Heterogeneous Federated Learning via Task Arithmetic Knowledge Integration NIPS 2024
Stronger, Lighter, Better: Towards Life-Long Attribute Value Extraction for E-Commerce Products ACL 2024
Efficient Toxic Content Detection by Bootstrapping and Distilling Large Language Models AAAI 2024
Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detection AAAI 2024
CyberQ: Generating Questions and Answers for Cybersecurity Education Using Knowledge Graph-Augmented LLMs AAAI 2024
Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Data EMNLP 2024
Hybrid Distillation from RBMT and NMT: Helsinki-NLP’s Submission to the Shared Task on Translation into Low-Resource Languages of Spain EMNLP 2024
DDK: Distilling Domain Knowledge for Efficient Large Language Models NIPS 2024
SHED: Shapley-Based Automated Dataset Refinement for Instruction Fine-Tuning NIPS 2024
Multimodal Machine Translation for Low-Resource Indic Languages: A Chain-of-Thought Approach Using Large Language Models EMNLP 2024
Enhancing Legal Expertise in Large Language Models through Composite Model Integration: The Development and Evaluation of Law-Neo EMNLP 2024
Adversarial Moment-Matching Distillation of Large Language Models NIPS 2024