conftrace_

sparsity pattern

8 papers

Explore in graph

Co-occurring keywords

model compression (3302) structured pruning (95) convex optimization (1321) neural network pruning (265) strongly convex function (31) accelerated method (12) first-order method (89) inference optimization (219) weight pruning (57) attention head (146)

Papers

Faster Accelerated First-order Methods for Convex Optimization with Strongly Convex Function Constraints NIPS 2024
Improved Generalization Bound and Learning of Sparsity Patterns for Data-Driven Low-Rank Approximation AISTATS 2023
GOHSP: A Unified Framework of Graph and Optimization-Based Heterogeneous Structured Pruning for Vision Transformer AAAI 2023
O(n) Connections are Expressive Enough: Universal Approximability of Sparse Transformers NIPS 2020
PCONV: The Missing but Desirable Sparsity in DNN Weight Pruning for Real-Time Execution on Mobile Devices AAAI 2020
Balanced Sparsity for Efficient DNN Inference on GPU AAAI 2019
A Family of Penalty Functions for Structured Sparsity NIPS 2010
Resolution Limits of Sparse Coding in High Dimensions NIPS 2008