conftrace_

linear looped transformers

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

fix-point iterative algorithms (1) population training loss (1) preconditioners (1) convergence (1) gradient descent (1)

Papers

Can Looped Transformers Learn to Implement Multi-step Gradient Descent for In-context Learning? ICML 2024