conftrace_

semantic cache

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (2) api caching (1) llm service (1) invocation method (1) input abstraction (1) vector similarity (1) cost reduction (1) inference optimization (1) response time (1)

Papers

A Framework for Effective Invocation Methods of Various LLM Services COLING 2025 GPTCache: An Open-Source Semantic Cache for LLM Applications Enabling Faster Answers and Cost Savings EMNLP 2023