conftrace_

gradient sketching

3 papers

Explore in graph

Co-occurring keywords

variance reduction (523) first-order method (89) variance-bias tradeoff (3) hessian vector product (2) hessian spectrum (8) first order optimization (2) data selection (221) generalization bound (652) moment matching (39) sinkhorn algorithm (64)

Papers

Sketchy Moment Matching: Toward Fast and Provable Data Selection for Finetuning NIPS 2024
Efficient Sketches for Training Data Attribution and Studying the Loss Landscape NIPS 2024
SEGA: Variance Reduction via Gradient Sketching NIPS 2018