conftrace_

orthogonal attention

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

overfitting (1) eigenfunctions (1) token orthogonalization (1) kernel integral (1) neural operator (1) efficient computing (1) object detection (1) regularization (1) self-attention mechanism (1) vision transformer (1)

Papers

Improved Operator Learning by Orthogonal Attention ICML 2024 Orthogonal Transformer: An Efficient Vision Transformer Backbone with Token Orthogonalization NeurIPS 2022