sparse training

Sparse High Rank Adapters NeurIPS 2024 Sparse maximal update parameterization: A holistic approach to sparse training dynamics NeurIPS 2024 S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-training NeurIPS 2024 TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge ICML 2024 Are Straight-Through Gradients and Soft-Thresholding All You Need for Sparse Training? WACV 2023 BayesTune: Bayesian Sparse Deep Model Fine-tuning NeurIPS 2023 Bi-directional Masks for Efficient N:M Sparse Training ICML 2023 Calibrating the Rigged Lottery: Making All Tickets Reliable ICLR 2023 Data Level Lottery Ticket Hypothesis for Vision Transformers IJCAI 2023 DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training ICLR 2023 Dynamic Sparsity Is Channel-Level Sparsity Learner NeurIPS 2023 ESL-SNNs: An Evolutionary Structure Learning Strategy for Spiking Neural Networks AAAI 2023 Iterative Soft Shrinkage Learning for Efficient Image Super-Resolution ICCV 2023 LOFT: Finding Lottery Tickets through Filter-wise Training AISTATS 2023 Lottery Tickets in Evolutionary Optimization: On Sparse Backpropagation-Free Trainability ICML 2023 Memory-Friendly Scalable Super-Resolution via Rewinding Lottery Ticket Hypothesis CVPR 2023 Network Expansion for Practical Training Acceleration CVPR 2023 Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training AAAI 2023 RLx2: Training a Sparse Deep Reinforcement Learning Model from Scratch ICLR 2023 Sparse Low-rank Adaptation of Pre-trained Language Models EMNLP 2023 SparseMAE: Sparse Training Meets Masked Autoencoders ICCV 2023 SparseProp: Efficient Sparse Backpropagation for Faster Training of Neural Networks at the Edge ICML 2023 Sparse Training with Lipschitz Continuous Loss Functions and a Weighted Group L0-norm Constraint JMLR 2023 Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints ICLR 2023 Structured Pruning for Efficient Generative Pre-trained Language Models ACL 2023