conftrace_

contextual sparsity

5 papers

Explore in graph

Also known as

CS

Co-occurring keywords · papers mentioning both

large language model (3) model compression (3) inference efficiency (2) latency reduction (1) token correction (1) temperature scaling (1) softmax nonlinearity (1) trainable parameter (1) reasoning task (1) efficiency optimization (1)

Papers

SparseLoRA: Accelerating LLM Fine-Tuning with Contextual Sparsity ICML 2025 Selective Attention: Enhancing Transformer through Principled Context Control NeurIPS 2024 ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models EMNLP 2024 SIRIUS : Contexual Sparisty with Correction for Efficient LLMs NeurIPS 2024 Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time ICML 2023