Skip to content
conftrace_

generative inference

6 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (3) throughput optimization (2) slow-and-low attack (1) flow behavior monitoring (1) distributed inference engine (1) tensor model parallelism (1) evidence ranking (1) llm serving (1) batch scheduling (1) heterogeneous network (1)

Papers

Defeating Slow-and-Low Threats via Diffusion Model-based Generative Inference NSDI 2026 GLIER: Generative Legal Inference and Evidence Ranking for Legal Case Retrieval ACL 2026 HexGen-2: Disaggregated Generative Inference of LLMs in Heterogeneous Environment ICLR 2025 HexGen: Generative Inference of Large Language Model over Heterogeneous Environment ICML 2024 Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs ICLR 2024 S^3: Increasing GPU Utilization during Generative Inference for Higher Throughput NeurIPS 2023