conftrace_

gradient accumulation

8 papers

Explore in graph

Also known as

GA

Co-occurring keywords · papers mentioning both

differentiable architecture search (1) dense retriever (1) self-supervised representation learning (1) memory bank (1) large language model (1) transformer model (1) multi-agent system (1) moving average (1) performance collapse (1) activation checkpointing (1)

Papers

Periodical Moving Average Accelerates Gradient Accumulation for Post-Training UAI 2025 A Gradient Accumulation Method for Dense Retriever under Memory Constraint NeurIPS 2024 Implicit Prompt Learning for Image Denoising IJCAI 2024 Towards efficient self-supervised representation learning in speech processing EACL 2024 Removing Data Heterogeneity Influence Enhances Network Topology Dependence of Decentralized SGD JMLR 2023 ROME: Robustifying Memory-Efficient NAS via Topology Disentanglement and Gradient Accumulation ICCV 2023 GRAM: Fast Fine-tuning of Pre-trained Language Models for Content-based Collaborative Filtering NAACL 2022 Tempo: Accelerating Transformer-Based Model Training through Memory Footprint Reduction NeurIPS 2022