conftrace_

gpt2

8 papers

Explore in graph

Co-occurring keywords · papers mentioning both

adamw (2) large language model (2) evolving subnetworks (1) flops saving (1) tinyllama (1) attention (1) improved variational online newton (ivon) (1) resnet (1) llama (1) lion (1)

Papers

Consensus Is All You Get: The Role of Attention in Transformers ICML 2025 EncryptedLLM: Privacy-Preserving Large Language Model Inference via GPU-Accelerated Fully Homomorphic Encryption ICML 2025 MARS: Unleashing the Power of Variance Reduction for Training Large Models ICML 2025 The Sharpness Disparity Principle in Transformers for Accelerating Language Model Pre-Training ICML 2025 Evolving Subnetwork Training for Large Language Models ICML 2024 Exact Conversion of In-Context Learning to Model Weights in Linearized-Attention Transformers ICML 2024 MADA: Meta-Adaptive Optimizers Through Hyper-Gradient Descent ICML 2024 Variational Learning is Effective for Large Deep Networks ICML 2024