conftrace_

Artificial Intelligence › Core AI ›

Knowledge Distillation

121 papers

Papers per year

1

2

9

13

12

19

29

14

22

Papers

LightReasoner: Can Small Language Models Teach Large Language Models Reasoning? ACL 2026

Multi-Granularity Semantic Revision for Large Language Model Distillation ACL 2026

Protecting Language Models Against Unauthorized Distillation through Trace Rewriting ACL 2026

Latent Agents: A Post-Training Procedure for Internalized Multi-Agent Debate ACL 2026

Long-Chain Reasoning Distillation via Adaptive Prefix Alignment ACL 2026

Distillation Traps and Guards: A Calibration Knob for LLM Distillability ACL 2026

MTA: Multi-Granular Trajectory Alignment for Large Language Model Distillation ACL 2026

TALAS: Teacher-Anchored Layer Alignment with Adaptive Sharpness-Aware Minimization for Embedding Distillation ACL 2026

SRA: Span Representation Alignment for Large Language Model Distillation ACL 2026

What Deserves Memory: Adaptive Memory Distillation for LLM Agents ACL 2026

LBLLM: Lightweight Binarization of Large Language Models via Three-Stage Distillation ACL 2026

MARD: Module-Aware Reasoning Distillation for Language Models with Adaptive Supervision ACL 2026

Can Compact Language Models Search Like Agents? Distillation-Guided Policy Optimization for Preserving Agentic RAG Capabilities ACL 2026

Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignment ACL 2026

Estimating the Black-box LLM Uncertainty with Distribution-Aligned Adversarial Distillation ACL 2026

LEAF: Knowledge Distillation of Text Embedding Models with Teacher-Aligned Representations ACL 2026

MIND: From Passive Mimicry to Active Reasoning through Capability-Aware Multi-Perspective CoT Distillation ACL 2026

ReasMark: A Robust Watermark for Attributing LLM Reasoning Under Knowledge Distillation Attacks ACL 2026

SharVeT: Similarity-aware Parameter Sharing with Vector-based Tuning for Efficient LLM Compression ACL 2026

What Question Did You Answer? Refining Contact Center Evaluation Plans via Backward Questions ACL 2026

Prompt-Level Distillation: A Non-Parametric Alternative to Model Fine-Tuning for Efficient Reasoning ACL 2026

Thinking with Reasoning Skills: Fewer Tokens, More Accuracy ACL 2026

Hierarchical Mixture of Experts: Generalizable Learning for High-Level Synthesis AAAI 2025

Neural-Symbolic Collaborative Distillation: Advancing Small Language Models for Complex Reasoning Tasks AAAI 2025

“Yes, My LoRD.” Guiding Language Model Extraction with Locality Reinforced Distillation ACL 2025