conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

Who Says Elephants Can’t Run: Bringing Large Scale MoE Models into Cloud Scale Production EMNLP 2022
Combining Explicit and Implicit Regularization for Efficient Learning in Deep Networks NIPS 2022
Sparse Structure Search for Delta Tuning NIPS 2022
Advancing Model Pruning via Bi-level Optimization NIPS 2022
Channel Pruning via Lookahead Search Guided Reinforcement Learning WACV 2022
Unity: Accelerating DNN Training Through Joint Optimization of Algebraic Transformations and Parallelization OSDI 2022
Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training NIPS 2022
Prior Gradient Mask Guided Pruning-Aware Fine-Tuning AAAI 2022
Towards Light-Weight and Real-Time Line Segment Detection AAAI 2022
Towards Fully Sparse Training: Information Restoration with Spatial Similarity AAAI 2022
Feedback Gradient Descent: Efficient and Stable Optimization with Orthogonality for DNNs AAAI 2022
Zero Stability Well Predicts Performance of Convolutional Neural Networks AAAI 2022
Understanding Stochastic Optimization Behavior at the Layer Update Level (Student Abstract) AAAI 2022
Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models EMNLP 2022
Memory-Efficient Training of RNN-Transducer with Sampled Softmax INTERSPEECH 2022
Sharpness-Aware Minimization with Dynamic Reweighting EMNLP 2022
DRAGONN: Distributed Randomized Approximate Gradients of Neural Networks ICML 2022
Multirate Training of Neural Networks ICML 2022
Minimizing Control for Credit Assignment with Strong Feedback ICML 2022
Sharpness-Aware Minimization Improves Language Model Generalization ACL 2022
Efficient Two-Stage Progressive Quantization of BERT EMNLP 2022
SE(3) Equivariant Graph Neural Networks with Complete Local Frames ICML 2022
MAML and ANIL Provably Learn Representations ICML 2022
Early Stage Convergence and Global Convergence of Training Mildly Parameterized Neural Networks NIPS 2022
Deep Differentiable Logic Gate Networks NIPS 2022