conftrace_

inference cost

35 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (14) model compression (9) knowledge distillation (5) model routing (4) inference optimization (3) mixture of expert (3) chain-of-thought reasoning (3) cost optimization (2) large reasoning model (2) token reduction (2)

Papers

Revisiting Non-Autoregressive Transformers for Efficient Image Synthesis CVPR 2024 BAYES RISK CTC: CONTROLLABLE CTC ALIGNMENT IN SEQUENCE-TO-SEQUENCE TASKS ICLR 2023 Frugal Prompting for Dialog Models EMNLP 2023 MULLER: Multilayer Laplacian Resizer for Vision ICCV 2023 Traversing Between Modes in Function Space for Fast Ensembling ICML 2023 A Fast Post-Training Pruning Framework for Transformers NeurIPS 2022 A Holistic Assessment of the Carbon Footprint of Noor, a Very Large Arabic Language Model ACL 2022 Accelerating BERT Inference for Sequence Labeling via Early-Exit ACL 2021 Amortized Neural Networks for Low-Latency Speech Recognition Interspeech 2021 Knowledge Evolution in Neural Networks CVPR 2021