conftrace_

auto-correct decoding

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

semi-autoregressive inference (1) semi-autoregressive generation (1) token generation (1) autoregressive language model (1) parallel decoding (1) speculative decoding (1) inference acceleration (1)

Papers

Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decoding ACL 2024