conftrace_

prompt compression

34 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (22) long context (4) retrieval-augmented generation (4) model compression (4) token-level compression (3) inference efficiency (3) inference optimization (3) efficient inference (3) in-context learning (3) knowledge distillation (3)

Papers

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression ACL 2024 LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression ACL 2024 Protecting Your LLMs with Information Bottleneck NeurIPS 2024 Selection-p: Self-Supervised Task-Agnostic Prompt Compression for Faithfulness and Transferability EMNLP 2024 Style-Compress: An LLM-Based Prompt Compression Framework Considering Task-Specific Styles EMNLP 2024 Symbolic Prompt Program Search: A Structure-Aware Approach to Efficient Compile-Time Prompt Optimization EMNLP 2024 Learning to Compress Prompts with Gist Tokens NeurIPS 2023 LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models EMNLP 2023 Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models EMNLP 2022