Self-Attention through Kernel-Eigen Pair Sparse Variational Gaussian Processes

Yingyi Chen; Qinghua Tao; Francesco Tonin; Johan Suykens

2024 ICML ICML 2024

Self-Attention through Kernel-Eigen Pair Sparse Variational Gaussian Processes

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Yingyi Chen, Qinghua Tao, Francesco Tonin, Johan Suykens

Topics

Machine Learning > Core Methods > Representation Learning Machine Learning > Optimization & Theory > Bayesian Inference Deep Learning > Architectures > Transformers

Keywords

singular value decomposition evidence lower bound self attention asymmetry kernel-eigen pair sparse variational gaussian processes

Download PDF