conftrace_

activation recomputation

4 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (2) reversible computing (1) auxiliary activation (1) long sequence training (1) memory-efficient training (1) reversible architecture (1) cross attention (1) visual token (1) communication overhead (1) model scaling (1)

Papers

LV-XAttn: Distributed Cross-Attention for Long Visual Inputs in Multimodal Large Language Models ICML 2025 Mini-Sequence Transformers: Optimizing Intermediate Memory for Long Sequences Training NeurIPS 2024 Learning with Auxiliary Activation for Memory-Efficient Training ICLR 2023 Reversible Vision Transformers CVPR 2022