conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

Learning Better Masking for Better Language Model Pre-training ACL 2023
Gradient Ascent Post-training Enhances Language Model Generalization ACL 2023
A Modern Look at the Relationship between Sharpness and Generalization ICML 2023
A Hyperparameter Optimization Toolkit for Neural Machine Translation Research ACL 2023
Training Trajectories of Language Models Across Scales ACL 2023
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering ACL 2023
A General Regret Bound of Preconditioned Gradient Method for DNN Training CVPR 2023
AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks AAAI 2023
Fast Convergence in Learning Two-Layer Neural Networks with Separable Data AAAI 2023
Implicit Stochastic Gradient Descent for Training Physics-Informed Neural Networks AAAI 2023
AIO-P: Expanding Neural Performance Predictors beyond Image Classification AAAI 2023
ESL-SNNs: An Evolutionary Structure Learning Strategy for Spiking Neural Networks AAAI 2023
Fixed-Weight Difference Target Propagation AAAI 2023
CSTAR: Towards Compact and Structured Deep Neural Networks with Adversarial Robustness AAAI 2023
Rebalancing Batch Normalization for Exemplar-Based Class-Incremental Learning CVPR 2023
DoG is SGD’s Best Friend: A Parameter-Free Dynamic Step Size Schedule ICML 2023
On the Initialization of Graph Neural Networks ICML 2023
Gradient Descent Monotonically Decreases the Sharpness of Gradient Flow Solutions in Scalar Networks and Beyond ICML 2023
AutoGraph: Optimizing DNN Computation Graph for Parallel GPU Kernel Execution AAAI 2023
Achieving High Accuracy with PINNs via Energy Natural Gradient Descent ICML 2023
Reinforcement Learning for Branch-and-Bound Optimisation Using Retrospective Trajectories AAAI 2023
Continual Learning with Scaled Gradient Projection AAAI 2023
SAMP: A Model Inference Toolkit of Post-Training Quantization for Text Processing via Self-Adaptive Mixed-Precision EMNLP 2023
Mimetic Initialization of Self-Attention Layers ICML 2023
AAAI New Faculty Highlights: General and Scalable Optimization for Robust AI AAAI 2023