Skip to content
conftrace_

early exit inference

4 papers

Explore in graph

Co-occurring keywords · papers mentioning both

early exit (3) adaptive inference (2) model compression (2) accuracy-latency tradeoff (1) internal classifier (1) latency awareness (1) large language model (1) suicide risk detection (1) threshold optimization (1) layer dropout (1)

Papers

LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding ACL 2024 RISE: Robust Early-exiting Internal Classifiers for Suicide Risk Evaluation COLING 2024 Binary Early-Exit Network for Adaptive Inference on Low-Resource Devices Interspeech 2022 Empowering Adaptive Early-Exit Inference with Latency Awareness AAAI 2021