Skip to content
conftrace_

activation sparsity

30 papers

Papers

Decomposing the Neurons: Activation Sparsity via Mixture of Experts for Continual Test Time Adaptation AAAI 2026 Dual Activation-Weight Sparsity: A Training-Free Framework for Efficient Large Language Model Compression ACL 2026 How Does Chain of Thought Think? Mechanistic Interpretability of Chain-of-Thought Reasoning with Sparse Autoencoding AAAI 2026 Kairox: Adaptive GPU-CPU Hybrid LLM Inference via Online Neuron Balancing OSDI 2026 Leveraging Sparsity for Privacy in Collaborative Inference WACV 2026 Features that Make a Difference: Leveraging Gradients for Improved Dictionary Learning NAACL 2025 From PEFT to DEFT: Parameter Efficient Finetuning for Reducing Activation Density in Transformers AAAI 2025 Large Learning Rates Simultaneously Achieve Robustness to Spurious Correlations and Compressibility ICCV 2025 La RoSA: Enhancing LLM Efficiency via Layerwise Rotated Sparse Activation ICML 2025 MixA-Q: Revisiting Activation Sparsity for Vision Transformers from a Mixed-Precision Quantization Perspective ICCV 2025 ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models COLING 2025 R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference ICLR 2025 Sparsing Law: Towards Large Language Models with Greater Activation Sparsity ICML 2025 Training-Free Activation Sparsity in Large Language Models ICLR 2025 Weight-Aware Activation Sparsity with Constrained Bayesian Optimization Scheduling for Large Language Models EMNLP 2025 Encourage or Inhibit Monosemanticity? Revisit Monosemanticity from a Feature Decorrelation Perspective EMNLP 2024 Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion NeurIPS 2024 Exploring the Benefit of Activation Sparsity in Pre-training ICML 2024 Learning Neural Networks with Sparse Activations COLT 2024 Learn To be Efficient: Build Structured Sparsity in Large Language Models NeurIPS 2024 MEFT: Memory-Efficient Fine-Tuning through Sparse Adapter ACL 2024 ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models ICLR 2024 SAS: Structured Activation Sparsification ICLR 2024 Emergence of Shape Bias in Convolutional Neural Networks through Activation Sparsity NeurIPS 2023 Sparse Coding in a Dual Memory System for Lifelong Learning AAAI 2023