conftrace_

api caching

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

semantic cache (1) large language model (1) vector similarity (1) cost reduction (1) inference optimization (1) response time (1)

Papers

GPTCache: An Open-Source Semantic Cache for LLM Applications Enabling Faster Answers and Cost Savings EMNLP 2023