Optimization

What is the Long-Run Distribution of Stochastic Gradient Descent? A Large Deviations Analysis ICML 2024 What makes unlearning hard and what to do about it NeurIPS 2024 What's in a Prior? Learned Proximal Networks for Inverse Problems ICLR 2024 When Are Two Lists Better than One?: Benefits and Harms in Joint Decision-Making AAAI 2024 When CEGAR Meets Regression: A Love Story in Optimal Classical Planning AAAI 2024 When Compression Meets Model Compression: Memory-Efficient Double Compression for Large Language Models EMNLP 2024 When Does Monolingual Data Help Multilingual Translation: The Role of Domain and Model Scale NAACL 2024 When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method ICLR 2024 When Will Gradient Regularization Be Harmful? ICML 2024 When will my ML Job finish? Toward providing Completion Time Estimates through Predictability-Centric Scheduling OSDI 2024 Where Do Large Learning Rates Lead Us? NeurIPS 2024 Who Needs Decoders? Efficient Estimation of Sequence-Level Attributes with Proxies EACL 2024 Who Plays First? Optimizing the Order of Play in Stackelberg Games with Many Robots RSS 2024 Why are Sensitive Functions Hard for Transformers? ACL 2024 Why Do We Need Weight Decay in Modern Deep Learning? NeurIPS 2024 Why is parameter averaging beneficial in SGD? An objective smoothing perspective AISTATS 2024 Why is SAM Robust to Label Noise? ICLR 2024 Word Alignment as Preference for Machine Translation EMNLP 2024 Worst-Case Offline Reinforcement Learning with Arbitrary Data Support NeurIPS 2024 Would I Lie To You? Inference Time Alignment of Language Models using Direct Preference Heads NeurIPS 2024 WRP: Weight Recover Prune for Structured Sparsity ACL 2024 X-former Elucidator: Reviving Efficient Attention for Long Context Language Modeling IJCAI 2024 XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection ACL 2024 You Only Need Less Attention at Each Stage in Vision Transformers CVPR 2024 Your contrastive learning problem is secretly a distribution alignment problem NeurIPS 2024