Optimization

Spanning Training Progress: Temporal Dual-Depth Scoring (TDDS) for Enhanced Dataset Pruning CVPR 2024 SPARKLE: A Unified Single-Loop Primal-Dual Framework for Decentralized Bilevel Optimization NeurIPS 2024 Sparse Dimensionality Reduction Revisited ICML 2024 SparseFlow: Accelerating Transformers by Sparsifying Information Flows ACL 2024 Sparse High Rank Adapters NeurIPS 2024 SparseLLM: Towards Global Pruning of Pre-trained Language Models NeurIPS 2024 Sparse Logistic Regression with High-order Features for Automatic Grammar Rule Extraction from Treebanks COLING 2024 Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging ICLR 2024 Sparse NMF with Archetypal Regularization: Computational and Robustness Properties JMLR 2024 SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Prediction CVPR 2024 Sparsest Models Elude Pruning: An Exposé of Pruning’s Current Capabilities ICML 2024 Sparse-to-dense Multimodal Image Registration via Multi-Task Learning ICML 2024 Sparse Weight Averaging with Multiple Particles for Iterative Magnitude Pruning ICLR 2024 Sparsity-Accelerated Training for Large Language Models ACL 2024 Speaking in Wavelet Domain: A Simple and Efficient Approach to Speed up Speech Diffusion Model EMNLP 2024 SpecExec: Massively Parallel Speculative Decoding For Interactive LLM Inference on Consumer Devices NeurIPS 2024 SpecHub: Provable Acceleration to Multi-Draft Speculative Decoding EMNLP 2024 Spectral Editing of Activations for Large Language Model Alignment NeurIPS 2024 Spectral Estimators for Structured Generalized Linear Models via Approximate Message Passing (Extended Abstract) COLT 2024 Spectral Graph Pruning Against Over-Squashing and Over-Smoothing NeurIPS 2024 Spectral Phase Transition and Optimal PCA in Block-Structured Spiked Models ICML 2024 Spectral Preconditioning for Gradient Methods on Graded Non-convex Functions ICML 2024 Spectral-Risk Safe Reinforcement Learning with Convergence Guarantees NeurIPS 2024 Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration NeurIPS 2024 Speculative Monte-Carlo Tree Search NeurIPS 2024