conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts EMNLP 2023
Balanced Column-Wise Block Pruning for Maximizing GPU Parallelism AAAI 2023
Regret Guarantees for Online Deep Control L4DC 2023
Primal and Dual Analysis of Entropic Fictitious Play for Finite-sum Problems ICML 2023
Equilibrium Point Learning ACML 2023
Stabilizing Transformer Training by Preventing Attention Entropy Collapse ICML 2023
Dissecting the Effects of SGD Noise in Distinct Regimes of Deep Learning ICML 2023
Fixed-Weight Difference Target Propagation AAAI 2023
Expected Gradients of Maxout Networks and Consequences to Parameter Initialization ICML 2023
The Hessian perspective into the Nature of Convolutional Neural Networks ICML 2023
SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient ICML 2023
Benign Overfitting in Two-layer ReLU Convolutional Neural Networks ICML 2023
Straightening Out the Straight-Through Estimator: Overcoming Optimization Challenges in Vector Quantized Networks ICML 2023
AdaNorm: Adaptive Gradient Norm Correction Based Optimizer for CNNs WACV 2023
Accumulated Trivial Attention Matters in Vision Transformers on Small Datasets WACV 2023
Dual Propagation: Accelerating Contrastive Hebbian Learning with Dyadic Neurons ICML 2023
Width and Depth Limits Commute in Residual Networks ICML 2023
ATFormer: A Learned Performance Model with Transfer Learning Across Devices for Deep Learning Tensor Programs EMNLP 2023
ATHENA: Mathematical Reasoning with Thought Expansion EMNLP 2023
Automated Knowledge Distillation via Monte Carlo Tree Search ICCV 2023
Learning to Generalize Provably in Learning to Optimize AISTATS 2023
Rapid Network Adaptation: Learning to Adapt Neural Networks Using Test-Time Feedback ICCV 2023
AutoGraph: Optimizing DNN Computation Graph for Parallel GPU Kernel Execution AAAI 2023
Towards Higher Pareto Frontier in Multilingual Machine Translation ACL 2023
Leveraging the two-timescale regime to demonstrate convergence of neural networks NIPS 2023