neural network optimization

Searching for Efficient Linear Layers over a Continuous Space of Structured Matrices NeurIPS 2024 Second-order forward-mode optimization of recurrent neural networks for neuroscience NeurIPS 2024 SGD Finds then Tunes Features in Two-Layer Neural Networks with near-Optimal Sample Complexity: A Case Study in the XOR problem ICLR 2024 SGD vs GD: Rank Deficiency in Linear Networks NeurIPS 2024 SHAP-EDITOR: Instruction-Guided Latent 3D Editing in Seconds CVPR 2024 Sharpness-Aware Minimization Enhances Feature Quality via Balanced Learning ICLR 2024 SHViT: Single-Head Vision Transformer with Memory Efficient Macro Design CVPR 2024 SimA: Simple Softmax-Free Attention for Vision Transformers WACV 2024 Sketching for Distributed Deep Learning: A Sharper Analysis NeurIPS 2024 Small-scale proxies for large-scale Transformer training instabilities ICLR 2024 SOI: Scaling Down Computational Complexity by Estimating Partial States of the Model NeurIPS 2024 Some Fundamental Aspects about Lipschitz Continuity of Neural Networks ICLR 2024 Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training ICLR 2024 Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference EACL 2024 Sparse Binarization for Fast Keyword Spotting Interspeech 2024 Sparse maximal update parameterization: A holistic approach to sparse training dynamics NeurIPS 2024 Speed of Light Exact Greedy Decoding for RNN-T Speech Recognition Models on GPU Interspeech 2024 SPIN: Sparsifying and Integrating Internal Neurons in Large Language Models for Text Classification ACL 2024 SS1: Accelerating Inference with Fast and Expressive Sketch Structured Transform NeurIPS 2024 Stable Language Model Pre-training by Reducing Embedding Variability EMNLP 2024 Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training NeurIPS 2024 Stochastic Fine-Tuning of Language Models Using Masked Gradients EMNLP 2024 Stochastic Modified Equations and Dynamics of Dropout Algorithm ICLR 2024 Stochastic Taylor Derivative Estimator: Efficient amortization for arbitrary differential operators NeurIPS 2024 StreamFlow: Streamlined Multi-Frame Optical Flow Estimation for Video Sequences NeurIPS 2024