conftrace_

token-level compression

3 papers

Explore in graph

Co-occurring keywords

prompt compression (32) large language model (13587) black-box model (90) rate-distortion theory (20) query-aware compression (1) black-box language model (6) long context (121) training-free method (40) distribution alignment (124) context window (73)

Papers

Perception Compressor: A Training-Free Prompt Compression Framework in Long Context Scenarios NAACL 2025
Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models NIPS 2024
LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models EMNLP 2023