conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

Scheduled DropHead: A Regularization Method for Transformer Models EMNLP 2020
How Can Self-Attention Networks Recognize Dyck-n Languages? EMNLP 2020
Improve Transformer Models with Better Relative Position Embeddings EMNLP 2020
An Empirical Investigation of Beam-Aware Training in Supertagging EMNLP 2020
Functional Gradient Boosting for Learning Residual-like Networks with Statistical Guarantees AISTATS 2020
Interference and Generalization in Temporal Difference Learning ICML 2020
Predicting Training Time Without Training NIPS 2020
RandAugment: Practical Automated Data Augmentation with a Reduced Search Space NIPS 2020
A Mean Field Analysis Of Deep ResNet And Beyond: Towards Provably Optimization Via Overparameterization From Depth ICML 2020
Confidence-Aware Learning for Deep Neural Networks ICML 2020
Go Wide, Then Narrow: Efficient Training of Deep Thin Networks ICML 2020
Harmonic Lowering for Accelerating Harmonic Convolution for Audio Signals INTERSPEECH 2020
Improved Training Strategies for End-to-End Speech Recognition in Digital Voice Assistants INTERSPEECH 2020
Network as Regularization for Training Deep Neural Networks: Framework, Model and Performance AAAI 2020
Long Short-Term Sample Distillation AAAI 2020
Understanding the Disharmony between Weight Normalization Family and Weight Decay AAAI 2020
The HSIC Bottleneck: Deep Learning without Back-Propagation AAAI 2020
PCONV: The Missing but Desirable Sparsity in DNN Weight Pruning for Real-Time Execution on Mobile Devices AAAI 2020
Group-Wise Dynamic Dropout Based on Latent Semantic Variations AAAI 2020
Sparsity-Inducing Binarized Neural Networks AAAI 2020
Pruning from Scratch AAAI 2020
MoBiNet: A Mobile Binary Network for Image Classification WACV 2020
ULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networks WACV 2020
Wide Hidden Expansion Layer for Deep Convolutional Neural Networks WACV 2020
Semantic Label Smoothing for Sequence to Sequence Problems EMNLP 2020