conftrace_

inference cost

28 papers

Explore in graph

Co-occurring keywords

large language model (13587) model compression (3302) knowledge distillation (3725) model routing (32) inference optimization (219) chain-of-thought reasoning (551) bert inference (6) large reasoning model (76) token reduction (68) early-exit mechanism (2)

Papers

Accelerating BERT Inference for Sequence Labeling via Early-Exit ACL 2021
Amortized Neural Networks for Low-Latency Speech Recognition INTERSPEECH 2021
Accelerating BERT Inference for Sequence Labeling via Early-Exit IJCNLP 2021