Skip to content
conftrace_

peer distillation

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

head pruning (1) attention head (1) language model (1) model compression (1)

Papers

Towards Lossless Head Pruning through Automatic Peer Distillation for Language Models IJCAI 2023