conftrace_

sparse training

77 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network pruning (265) lottery ticket hypothesis (104) network pruning (183) neural network optimization (1293) neural network (6616) vision transformer (1106) training acceleration (33) model pruning (237) edge computing (210)

Papers

Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning Better AAAI 2022
Dynamic Forward and Backward Sparse Training (DFBST): Accelerated Deep Learning through Completely Sparse Training Schedule ACML 2022
Pruning’s Effect on Generalization Through the Lens of Training and Regularization NIPS 2022
Training Your Sparse Neural Network Better with Any Mask ICML 2022
The State of Sparse Training in Deep Reinforcement Learning ICML 2022
Monarch: Expressive Structured Matrices for Efficient and Accurate Training ICML 2022
Winning the Lottery Ahead of Time: Efficient Early Network Pruning ICML 2022
The Elastic Lottery Ticket Hypothesis NIPS 2021
MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge NIPS 2021
Training Neural Networks with Fixed Sparse Masks NIPS 2021
Winning Lottery Tickets in Deep Generative Models AAAI 2021
Efficient Neural Network Training via Forward and Backward Propagation Sparsification NIPS 2021
AC/DC: Alternating Compressed/DeCompressed Training of Deep Neural Networks NIPS 2021
A Unified Lottery Ticket Hypothesis for Graph Neural Networks ICML 2021
Powerpropagation: A sparsity inducing weight reparameterisation NIPS 2021
Efficient Lottery Ticket Finding: Less Data is More ICML 2021
Chasing Sparsity in Vision Transformers: An End-to-End Exploration NIPS 2021
ReSprop: Reuse Sparsified Backpropagation CVPR 2020
Sparse Weight Activation Training NIPS 2020
Winning the Lottery with Continuous Sparsification NIPS 2020
The Lottery Ticket Hypothesis for Pre-trained BERT Networks NIPS 2020
Pruning neural networks without any data by iteratively conserving synaptic flow NIPS 2020
Top-KAST: Top-K Always Sparse Training NIPS 2020
Global Sparse Momentum SGD for Pruning Very Deep Neural Networks NIPS 2019
One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers NIPS 2019