conftrace_

optimizer comparison

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

learning rate tuning (1) fine-tuning transformer (1) adaptive optimizer (1) hyperparameter tuning (1)

Papers

Should I try multiple optimizers when fine-tuning a pre-trained Transformer for NLP tasks? Should I tune their hyperparameters? EACL 2024