Valerii Likhosherstov
17 papers · 2019–2024 · 5 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+11 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (12) π§ Keyword Pioneer π Renaissance Researcher (5) π Interdisciplinary Bridge π£ Hot Topic Early Bird
π
Academic Marathon
(5)
πΊοΈ
Taxonomy Completionist
(12)
π§
Keyword Pioneer
π€
Dynamic Duo
(14)
π
Triple Crown
π
Grand Slam
π
Keyword Champion
(2)
π₯
Unstoppable
(6)
β‘
Prolific Year
(5)
ποΈ
Keyword Collector
(68)
π
Century Club
(17)
Conferences
ICML (7)
NIPS (4)
ICLR (3)
AISTATS (2)
AAAI (1)
Top co-authors
Keywords
kernel approximation
(3)
transformer architecture
(3)
gaussian kernel
(3)
softmax kernel
(3)
graph theory
(3)
linear attention
(2)
orthogonal group
(2)
stochastic gradient descent
(2)
spectral analysis
(2)
random feature
(2)
ising model
(1)
theoretical analysis
(1)
matrix factorization
(1)
parallel computing
(1)
point cloud
(1)
language modeling
(1)
self-attention mechanism
(1)
variance reduction
(1)
kernel regression
(1)
fast multipole method
(1)
Papers
Scalable Neural Network Kernels
ICLR 2024
Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
AISTATS 2024
Efficient Graph Field Integrators Meet Point Clouds
ICML 2023
On the Expressive Flexibility of Self-Attention Matrices
AAAI 2023
Simplex Random Features
ICML 2023
Dense-Exponential Random Features: Sharp Positive Estimators of the Gaussian Kernel
NIPS 2023
Adaptive Computation with Elastic Input Sequence
ICML 2023
Hybrid Random Features
ICLR 2022
Chefs' Random Tables: Non-Trigonometric Random Features
NIPS 2022
From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers
ICML 2022
Sub-Linear Memory: How to Make Performers SLiM
NIPS 2021
Debiasing a First-order Heuristic for Approximate Bi-level Optimization
ICML 2021
Rethinking Attention with Performers
ICLR 2021
CWY Parametrization: a Solution for Parallelized Optimization of Orthogonal and Stiefel Matrices
AISTATS 2021
Stochastic Flows and Geometric Optimization on the Orthogonal Group
ICML 2020
Ode to an ODE
NIPS 2020
Inference and Sampling of $K_33$-free Ising Models
ICML 2019