conftrace_

generalization gap

42 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) generalization bound (652) neural network optimization (1293) neural network (6616) adversarial training (1262) adversarial robustness (1341) large batch training (10) pac-bayes bound (53) flat minima (50) large language model (13587)

Papers

Rate-Distortion Analysis of Minimum Excess Risk in Bayesian Learning ICML 2021
An Information-Geometric Distance on the Space of Tasks ICML 2021
Predicting Deep Neural Network Generalization with Perturbation Response Curves NIPS 2021
More Data Can Expand The Generalization Gap Between Adversarially Robust and Standard Models ICML 2020
On the interplay between noise and curvature and its effect on optimization and generalization AISTATS 2020
Towards Theoretically Understanding Why Sgd Generalizes Better Than Adam in Deep Learning NIPS 2020
A Statistical Mechanics Framework for Task-Agnostic Sample Design in Machine Learning NIPS 2020
UNAS: Differentiable Architecture Search Meets Reinforcement Learning CVPR 2020
Extrapolation for Large-batch Training in Deep Learning ICML 2020
Learning Optimal Representations with the Decodable Information Bottleneck NIPS 2020
Interference and Generalization in Temporal Difference Learning ICML 2020
Generalization in Generative Adversarial Networks: A Novel Perspective from Privacy Protection NIPS 2019
Learning Optimal Linear Regularizers ICML 2019
On the Generalization Gap in Reparameterizable Reinforcement Learning ICML 2019
A Refined Margin Distribution Analysis for Forest Representation Learning NIPS 2019
Hessian-based Analysis of Large Batch Training and Robustness to Adversaries NIPS 2018
Train longer, generalize better: closing the generalization gap in large batch training of neural networks NIPS 2017