conftrace_

activation sparsity

30 papers

Explore in graph

Co-occurring keywords · papers mentioning both

model compression (10) large language model (9) neural network optimization (5) inference efficiency (4) inference acceleration (3) mixture of expert (3) convolutional neural network (3) magnitude-based pruning (2) window attention (2) mechanistic interpretability (2)

Papers

SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer CVPR 2023 The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in Transformers ICLR 2023 Post-Training Sparsity-Aware Quantization NeurIPS 2021 Inducing and Exploiting Activation Sparsity for Fast Inference on Deep Neural Networks ICML 2020 Efficient Sparse-Winograd Convolutional Neural Networks ICLR 2018