conftrace_

shuffling strategy

5 papers

Explore in graph

Co-occurring keywords

convergence analysis (395) non-convex optimization (547) stochastic gradient descent (1091) convergence bound (17) perplexity reduction (7) gradient method (29) autoregressive language model (58) primal-dual analysis (3) data permutation (3) shuffled stochastic gradient descent (1)

Papers

Optimizing Packing and Shuffling Strategies for Enhanced Performance in Generative Language Models ACL 2026
Tighter Convergence Bounds for Shuffled SGD via Primal-Dual Perspective NIPS 2024
On the Convergence to a Global Solution of Shuffling-Type Gradient Algorithms NIPS 2023
A Unified Convergence Analysis for Shuffling-Type Gradient Methods JMLR 2021
SMG: A Shuffling Gradient-Based Method with Momentum ICML 2021