conftrace_

inference cost

28 papers

Explore in graph

Co-occurring keywords

large language model (13587) model compression (3302) knowledge distillation (3725) model routing (32) inference optimization (219) chain-of-thought reasoning (551) bert inference (6) large reasoning model (76) token reduction (68) early-exit mechanism (2)

Papers

Confidence-Guided Stepwise Model Routing for Cost-Efficient Reasoning AAAI 2026
AutoTool: Efficient Tool Selection for Large Language Model Agents AAAI 2026
MTRouter: Cost-Aware Multi-Turn LLM Routing with History–Model Joint Embeddings ACL 2026
Think How to Think: Mitigating Overthinking with Autonomous Difficulty Cognition in Large Reasoning Models ACL 2026
Trade-offs in Large Reasoning Models: An Empirical Analysis of Deliberative and Adaptive Reasoning over Foundational Capabilities AAAI 2026
Answer Convergence as a Signal for Early Stopping in Reasoning EMNLP 2025
Scalable and Cost Effective High-Cardinality Classification with LLMs via Multi-View Label Representations and Retrieval Augmentation EMNLP 2025
You Only Read Once (YORO): Learning to Internalize Database Knowledge for Text-to-SQL NAACL 2025
SkewRoute: Training-Free LLM Routing for Knowledge Graph Retrieval-Augmented Generation via Score Skewness of Retrieved Context EMNLP 2025
TwT: Thinking without Tokens by Habitual Reasoning Distillation with Multi-Teachers’ Guidance EMNLP 2025
Select-then-Route : Taxonomy guided Routing for LLMs EMNLP 2025
Are Optimal Algorithms Still Optimal? Rethinking Sorting in LLM-Based Pairwise Ranking with Batching and Caching ACL 2025
Make Every Penny Count: Difficulty-Adaptive Self-Consistency for Cost-Efficient Reasoning NAACL 2025
GRASP: Replace Redundant Layers with Adaptive Singular Parameters for Efficient Model Compression EMNLP 2025
Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion NIPS 2024
Breaking ReLU Barrier: Generalized MoEfication for Dense Pretrained Models EMNLP 2024
Retaining Key Information under High Compression Ratios: Query-Guided Compressor for LLMs ACL 2024
Revisiting Non-Autoregressive Transformers for Efficient Image Synthesis CVPR 2024
Divide-or-Conquer? Which Part Should You Distill Your LLM? EMNLP 2024
MULLER: Multilayer Laplacian Resizer for Vision ICCV 2023
Frugal Prompting for Dialog Models EMNLP 2023
Traversing Between Modes in Function Space for Fast Ensembling ICML 2023
A Holistic Assessment of the Carbon Footprint of Noor, a Very Large Arabic Language Model ACL 2022
A Fast Post-Training Pruning Framework for Transformers NIPS 2022
Knowledge Evolution in Neural Networks CVPR 2021