attention layer

Conditional Balance: Improving Multi-Conditioning Trade-Offs in Image Generation CVPR 2025 Constrained Belief Updates Explain Geometric Structures in Transformer Representations ICML 2025 Constraint-Aware Feature Learning for Parametric Point Cloud ICCV 2025 Distributional Associations vs In-Context Reasoning: A Study of Feed-forward and Attention Layers ICLR 2025 Everything is Editable: Extend Knowledge Editing to Unstructured Data in Large Language Models ICLR 2025 How Transformers Learn Regular Language Recognition: A Theoretical Study on Training Dynamics and Implicit Bias ICML 2025 In-Context Denoising with One-Layer Transformers: Connections between Attention and Associative Memory Retrieval ICML 2025 Precise Parameter Localization for Textual Generation in Diffusion Models ICLR 2025 When LRP Diverges from Leave-One-Out in Transformers EMNLP 2025 Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks ICML 2024 Enhancing Parameter-efficient Fine-tuning with Simple Calibration Based on Stable Rank COLING 2024 Generative Enzyme Design Guided by Functionally Important Sites and Small-Molecule Substrates ICML 2024 Pre-trained Large Language Models Use Fourier Features to Compute Addition NeurIPS 2024 SparQ Attention: Bandwidth-Efficient LLM Inference ICML 2024 Towards Understanding the Word Sensitivity of Attention Layers: A Study via Random Features ICML 2024 Weight decay induces low-rank attention layers NeurIPS 2024 What Can Transformer Learn with Varying Depth? Case Studies on Sequence Learning Tasks ICML 2024 Why do LLaVA Vision-Language Models Reply to Images in English? EMNLP 2024 Editing Common Sense in Transformers EMNLP 2023 Jigsaw: Learning to Assemble Multiple Fractured Objects NeurIPS 2023 Representational Strengths and Limitations of Transformers NeurIPS 2023 Self-Detoxifying Language Models via Toxification Reversal EMNLP 2023 What can a Single Attention Layer Learn? A Study Through the Random Features Lens NeurIPS 2023 White-box Testing of NLP models with Mask Neuron Coverage NAACL 2022 Neural Machine Translation with Universal Visual Representation ICLR 2020