Skip to content
conftrace_

linear transformer block

1 paper

Explore in graph

Also known as

LTB

Co-occurring keywords · papers mentioning both

multi-layer perceptron (1) linear attention (1) linear transformer (1) gradient descent initialization (1) bayes optimal (1) approximation error (1) gradient descent (1) in-context learning (1)

Papers

In-Context Learning of a Linear Transformer Block: Benefits of the MLP Component and One-Step GD Initialization NeurIPS 2024