conftrace_

stochastic weight averaging

13 papers

Explore in graph

Also known as

SWA

Co-occurring keywords

flat minima (50) uncertainty estimation (648) model stability (27) language model (4599) neural network optimization (1293) model calibration (232) uncertainty quantification (1393) ensemble learning (1274) model generalization (190) weight averaging (25)

Papers

Post-Hoc Reversal: Are We Selecting Models Prematurely? NIPS 2024
Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations NIPS 2024
Deep Combinatorial Aggregation NIPS 2022
Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging EMNLP 2022
When Do Flat Minima Optimizers Work? NIPS 2022
SpectraNet: Learned Recognition of Artificial Satellites From High Contrast Spectroscopic Imagery WACV 2022
How Emotionally Stable is ALBERT? Testing Robustness with Stochastic Weight Averaging on a Sentiment Analysis Task EMNLP 2021
Learning Neural Network Subspaces ICML 2021
SWAD: Domain Generalization by Seeking Flat Minima NIPS 2021
Language Recognition on Unknown Conditions: The LORIA-Inria-MULTISPEECH System for AP20-OLR Challenge INTERSPEECH 2021
SWALP : Stochastic Weight Averaging in Low Precision Training ICML 2019
On Model Stability as a Function of Random Seed CONLL 2019
A Simple Baseline for Bayesian Uncertainty in Deep Learning NIPS 2019