neural network optimization

Scaling Forward Gradient With Local Losses ICLR 2023 Scaling Laws For Deep Learning Based Image Reconstruction ICLR 2023 Separable Physics-Informed Neural Networks NeurIPS 2023 SERF: Towards Better Training of Deep Neural Networks Using Log-Softplus ERror Activation Function WACV 2023 Simulated Annealing in Early Layers Leads to Better Generalization CVPR 2023 SLAMB: Accelerated Large Batch Training with Sparse Communication ICML 2023 Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization ACL 2023 Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Models NeurIPS 2023 Solving Oscillation Problem in Post-Training Quantization Through a Theoretical Perspective CVPR 2023 Sound Randomized Smoothing in Floating-Point Arithmetic ICLR 2023 Sparse tree-based Initialization for Neural Networks ICLR 2023 SPT: Learning to Selectively Insert Prompts for Better Prompt Tuning EMNLP 2023 SSF: Accelerating Training of Spiking Neural Networks with Stabilized Spiking Flow ICCV 2023 Stabilizing Transformer Training by Preventing Attention Entropy Collapse ICML 2023 StEik: Stabilizing the Optimization of Neural Signed Distance Functions and Finer Shape Representation NeurIPS 2023 Straightening Out the Straight-Through Estimator: Overcoming Optimization Challenges in Vector Quantized Networks ICML 2023 Sub-network Discovery and Soft-masking for Continual Learning of Mixed Tasks EMNLP 2023 SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient ICML 2023 Tanh Works Better with Asymmetry NeurIPS 2023 TAN Without a Burn: Scaling Laws of DP-SGD ICML 2023 Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering ACL 2023 Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers EACL 2023 Temporal Graph Neural Networks for Irregular Data AISTATS 2023 The Crucial Role of Normalization in Sharpness-Aware Minimization NeurIPS 2023 The Differentiable Lens: Compound Lens Search Over Glass Surfaces and Materials for Object Detection CVPR 2023