neural network optimization

How Well Can a Genetic Algorithm Fine-tune Transformer Encoders? A First Approach NAACL 2024 HydraViT: Stacking Heads for a Scalable ViT NeurIPS 2024 Identifying Equivalent Training Dynamics NeurIPS 2024 If You Want to Be Robust, Be Wary of Initialization NeurIPS 2024 Implicit Regularization of Sharpness-Aware Minimization for Scale-Invariant Problems NeurIPS 2024 Improved Techniques for Quantizing Deep Networks With Adaptive Bit-Widths WACV 2024 Improving Convergence and Generalization Using Parameter Symmetries ICLR 2024 Improving Equivariant Model Training via Constraint Relaxation NeurIPS 2024 Improving Generalization and Convergence by Enhancing Implicit Regularization NeurIPS 2024 Improving the Learning Capability of Small-size Image Restoration Network by Deep Fourier Shifting NeurIPS 2024 Improving Training Efficiency of Diffusion Models via Multi-Stage Framework and Tailored Multi-Decoder Architecture CVPR 2024 In-context Learning and Gradient Descent Revisited NAACL 2024 Increasing Model Capacity for Free: A Simple Strategy for Parameter Efficient Fine-tuning ICLR 2024 Infinite Limits of Multi-head Transformer Dynamics NeurIPS 2024 Initialization is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing NeurIPS 2024 Initialization of Large Language Models via Reparameterization to Mitigate Loss Spikes EMNLP 2024 Inspecting Prediction Confidence for Detecting Black-Box Backdoor Attacks AAAI 2024 Internal Cross-layer Gradients for Extending Homogeneity to Heterogeneity in Federated Learning ICLR 2024 Investigation into Training Dynamics of Learned Optimizers (Student Abstract) AAAI 2024 Jointly-Learned Exit and Inference for a Dynamic Neural Network ICLR 2024 JointSQ: Joint Sparsification-Quantization for Distributed Learning CVPR 2024 Jump to Conclusions: Short-Cutting Transformers with Linear Transformations COLING 2024 Latent Modulated Function for Computational Optimal Continuous Image Representation CVPR 2024 Layer Collaboration in the Forward-Forward Algorithm AAAI 2024 Layer Compression of Deep Networks with Straight Flows AAAI 2024