Skip to content
conftrace_

fine-tuning transformer

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

optimizer comparison (1) learning rate tuning (1) adaptive optimizer (1) hyperparameter tuning (1)

Papers

Should I try multiple optimizers when fine-tuning a pre-trained Transformer for NLP tasks? Should I tune their hyperparameters? EACL 2024