neural network optimization

X-former Elucidator: Reviving Efficient Attention for Long Context Language Modeling IJCAI 2024 You Only Need Less Attention at Each Stage in Vision Transformers CVPR 2024 AAAI New Faculty Highlights: General and Scalable Optimization for Robust AI AAAI 2023 Acceleration of Large Transformer Model Training by Sensitivity-Based Layer Dropping AAAI 2023 Accumulated Trivial Attention Matters in Vision Transformers on Small Datasets WACV 2023 A Characteristic Function-Based Method for Bottom-Up Human Pose Estimation CVPR 2023 Achieving O(ε^-1.5) Complexity in Hessian/Jacobian-free Stochastic Bilevel Optimization NeurIPS 2023 Achieving High Accuracy with PINNs via Energy Natural Gradient Descent ICML 2023 ActMAD: Activation Matching To Align Distributions for Test-Time-Training CVPR 2023 AdaNorm: Adaptive Gradient Norm Correction Based Optimizer for CNNs WACV 2023 AGD: an Auto-switchable Optimizer using Stepwise Gradient Difference for Preconditioning Matrix NeurIPS 2023 A General Regret Bound of Preconditioned Gradient Method for DNN Training CVPR 2023 A Guide Through the Zoo of Biased SGD NeurIPS 2023 A Hyperparameter Optimization Toolkit for Neural Machine Translation Research ACL 2023 AIO-P: Expanding Neural Performance Predictors beyond Image Classification AAAI 2023 Algebraically Rigorous Quaternion Framework for the Neural Network Pose Estimation Problem ICCV 2023 Alternating Updates for Efficient Transformers NeurIPS 2023 A Modern Look at the Relationship between Sharpness and Generalization ICML 2023 ASkewSGD : An Annealed interval-constrained Optimisation method to train Quantized Neural Networks AISTATS 2023 A Survey on Model Compression and Acceleration for Pretrained Language Models AAAI 2023 ATFormer: A Learned Performance Model with Transfer Learning Across Devices for Deep Learning Tensor Programs EMNLP 2023 ATHENA: Mathematical Reasoning with Thought Expansion EMNLP 2023 A Unified Optimization Framework of ANN-SNN Conversion: Towards Optimal Mapping from Activation Values to Firing Rates ICML 2023 AutoGraph: Optimizing DNN Computation Graph for Parallel GPU Kernel Execution AAAI 2023 AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks AAAI 2023