Optimization & Theory

Provable Acceleration of Nesterov's Accelerated Gradient for Asymmetric Matrix Factorization and Linear Neural Networks NeurIPS 2024 Provable Acceleration of Nesterov’s Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks IJCAI 2024 Provable and Efficient Dataset Distillation for Kernel Ridge Regression NeurIPS 2024 Provable Robustness against a Union of L_0 Adversarial Attacks AAAI 2024 Provable Tempered Overfitting of Minimal Nets and Typical Nets NeurIPS 2024 Provably Transformers Harness Multi-Concept Word Semantics for Efficient In-Context Learning NeurIPS 2024 Proving Linear Mode Connectivity of Neural Networks via Optimal Transport AISTATS 2024 ProxyFusion: Face Feature Aggregation Through Sparse Experts NeurIPS 2024 Pruning Foundation Models for High Accuracy without Retraining EMNLP 2024 Pruning is Optimal for Learning Sparse Features in High-Dimensions COLT 2024 Pruning Large Language Models to Intra-module Low-rank Architecture with Transitional Activations ACL 2024 Pruning Multilingual Large Language Models for Multilingual Inference EMNLP 2024 Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging EMNLP 2024 PSC: Extending Context Window of Large Language Models via Phase Shift Calibration EMNLP 2024 PTMQ: Post-training Multi-Bit Quantization of Neural Networks AAAI 2024 PTQ4DiT: Post-training Quantization for Diffusion Transformers NeurIPS 2024 PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression NeurIPS 2024 PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference ACL 2024 QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning EMNLP 2024 QEFT: Quantization for Efficient Fine-Tuning of LLMs EMNLP 2024 QLABGrad: A Hyperparameter-Free and Convergence-Guaranteed Scheme for Deep Learning AAAI 2024 Q-SENN: Quantized Self-Explaining Neural Networks AAAI 2024 QTIP: Quantization with Trellises and Incoherence Processing NeurIPS 2024 QT-ViT: Improving Linear Attention in ViT with Quadratic Taylor Expansion NeurIPS 2024 QuanTA: Efficient High-Rank Fine-Tuning of LLMs with Quantum-Informed Tensor Adaptation NeurIPS 2024