Skip to content
conftrace_

loss landscape analysis

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

hessian eigenspectrum (1) flatter minima (1) binary masking (1) neural network (1) layer-wise regularization (1) binary mask (1) generalization performance (1) memory footprint (1) pre-trained language model (1) parameter-efficient tuning (1)

Papers

A Deeper Look at the Hessian Eigenspectrum of Deep Neural Networks and its Applications to Regularization AAAI 2021 Masking as an Efficient Alternative to Finetuning for Pretrained Language Models EMNLP 2020