conftrace_

activation sparsity

20 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) inference acceleration (244) inference efficiency (248) mixture of expert (640) neural network optimization (1293) window attention (24) mechanistic interpretability (133) sparse autoencoder (112) parameter-efficient fine-tuning (736)

Papers

How Does Chain of Thought Think? Mechanistic Interpretability of Chain-of-Thought Reasoning with Sparse Autoencoding AAAI 2026
Decomposing the Neurons: Activation Sparsity via Mixture of Experts for Continual Test Time Adaptation AAAI 2026
Dual Activation-Weight Sparsity: A Training-Free Framework for Efficient Large Language Model Compression ACL 2026
Leveraging Sparsity for Privacy in Collaborative Inference WACV 2026
Features that Make a Difference: Leveraging Gradients for Improved Dictionary Learning NAACL 2025
ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models COLING 2025
From PEFT to DEFT: Parameter Efficient Finetuning for Reducing Activation Density in Transformers AAAI 2025
MixA-Q: Revisiting Activation Sparsity for Vision Transformers from a Mixed-Precision Quantization Perspective ICCV 2025
Large Learning Rates Simultaneously Achieve Robustness to Spurious Correlations and Compressibility ICCV 2025
Weight-Aware Activation Sparsity with Constrained Bayesian Optimization Scheduling for Large Language Models EMNLP 2025
Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion NIPS 2024
MEFT: Memory-Efficient Fine-Tuning through Sparse Adapter ACL 2024
Encourage or Inhibit Monosemanticity? Revisit Monosemanticity from a Feature Decorrelation Perspective EMNLP 2024
Learning Neural Networks with Sparse Activations COLT 2024
Learn To be Efficient: Build Structured Sparsity in Large Language Models NIPS 2024
Sparse Coding in a Dual Memory System for Lifelong Learning AAAI 2023
Emergence of Shape Bias in Convolutional Neural Networks through Activation Sparsity NIPS 2023
SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer CVPR 2023
Post-Training Sparsity-Aware Quantization NIPS 2021
Inducing and Exploiting Activation Sparsity for Fast Inference on Deep Neural Networks ICML 2020