conftrace_

sequence packing

4 papers

Explore in graph

Co-occurring keywords · papers mentioning both

context continuity (1) native resolution (1) offline preference learning (1) image-text pre-training (1) variable-length input (1) large language model (1) audio spectrogram transformer (1) data packing (1) context discontinuity (1) contrastive pre-training (1)

Papers

Improving Continual Pre-training Through Seamless Data Packing ACL 2025 ElasticAST: An Audio Spectrogram Transformer for All Length and Resolutions Interspeech 2024 LIONs: An Empirically Optimized Approach to Align Language Models EMNLP 2024 Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution NeurIPS 2023