Skip to content
conftrace_

activation boundary

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

knowledge distillation (2) transfer learning (2) model compression (2) hidden neuron (1) separation boundary (1) neural network (1) teacher network (1) teacher-student learning (1) student network (1) pre-trained language model (1)

Papers

Domain Knowledge Transferring for Pre-trained Language Model via Calibrated Activation Boundary Distillation ACL 2022 Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons AAAI 2019