← Keywords

neural network training

309 papers

Explore in graph

Also known as

DNN NNT

Co-occurring keywords

neural network (6616) neural network optimization (1293) stochastic gradient descent (1088) gradient descent (1143) model compression (3283) deep neural network (1801) stochastic optimization (1060) deep learning (2111) batch normalization (222) non-convex optimization (546)

Papers

Non-Vacuous Generalisation Bounds for Shallow Neural Networks ICML 2022
Exploiting Invariance in Training Deep Neural Networks AAAI 2022
Secure Quantized Training for Deep Learning ICML 2022
Dataset Distillation using Neural Feature Regression NIPS 2022
Analyzing Sharpness along GD Trajectory: Progressive Sharpening and Edge of Stability NIPS 2022
Feature Learning and Signal Propagation in Deep Neural Networks ICML 2022
A Deep Learning Dataloader with Shared Data Preparation NIPS 2022
A Re-Balancing Strategy for Class-Imbalanced Classification Based on Instance Difficulty CVPR 2022
Active Boundary Loss for Semantic Segmentation AAAI 2022
Towards Understanding the Condensation of Neural Networks at Initial Training NIPS 2022
AMP: Automatically Finding Model Parallel Strategies with Heterogeneity Awareness NIPS 2022
SAPipe: Staleness-Aware Pipeline for Data Parallel DNN Training NIPS 2022
Gradient Descent on Neurons and its Link to Approximate Second-order Optimization ICML 2022
AI Snap! Blocks for Speech Input and Output, Computer Vision, Word Embeddings, and Neural Net Creation, Training, and Use AAAI 2022
Scaled ReLU Matters for Training Vision Transformers AAAI 2022
A Unified Weight Initialization Paradigm for Tensorial Convolutional Neural Networks ICML 2022
Learning by Competition of Self-Interested Reinforcement Learning Agents AAAI 2022
Don’t Take It Literally: An Edit-Invariant Sequence Loss for Text Generation NAACL 2022
A Differential Entropy Estimator for Training Neural Networks ICML 2022
Online Knowledge Distillation by Temporal-Spatial Boosting WACV 2022
A Unified Framework for Implicit Sinkhorn Differentiation CVPR 2022
Overparameterization of Deep ResNet: Zero Loss and Mean-field Analysis JMLR 2022
When Hardness of Approximation Meets Hardness of Learning JMLR 2022
Deep Learning in Target Space JMLR 2022
Masked Training of Neural Networks with Partial Gradients AISTATS 2022