singular value decomposition

Talking Heads: Understanding Inter-Layer Communication in Transformer Language Models NeurIPS 2024 Tensor-Based Synchronization and the Low-Rankness of the Block Trifocal Tensor NeurIPS 2024 Unveiling LoRA Intrinsic Ranks via Salience Analysis NeurIPS 2024 Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning ICLR 2023 Continual Learning with Scaled Gradient Projection AAAI 2023 Dimensionality Reduction for Machine Learning-based Argument Mining EMNLP 2023 Dynamic Low-rank Estimation for Transformer-based Language Models EMNLP 2023 Efficient Distribution Similarity Identification in Clustered Federated Learning via Principal Angles between Client Data Subspaces AAAI 2023 Efficient Robust Principal Component Analysis via Block Krylov Iteration and CUR Decomposition CVPR 2023 Global Explanations for Image Classifiers (Student Abstract) AAAI 2023 LightFormer: Light-weight Transformer Using SVD-based Weight Transfer and Parameter Sharing ACL 2023 LightGCL: Simple Yet Effective Graph Contrastive Learning for Recommendation ICLR 2023 On the Power of SVD in the Stochastic Block Model NeurIPS 2023 Primal-Attention: Self-attention through Asymmetric Kernel SVD in Primal Representation NeurIPS 2023 Representations and Exploration for Deep Reinforcement Learning using Singular Value Decomposition ICML 2023 Residual Alignment: Uncovering the Mechanisms of Residual Networks NeurIPS 2023 Sampling-based Nyström Approximation and Kernel Quadrature ICML 2023 Singularformer: Learning to Decompose Self-Attention to Linearize the Complexity of Transformer IJCAI 2023 Singular Value Representation: A New Graph Perspective On Neural Networks AISTATS 2023 SVD-DIP: Overcoming the Overfitting Problem in DIP-based CT Reconstruction MIDL 2023 SVDiff: Compact Parameter Space for Diffusion Fine-Tuning ICCV 2023 Tackling Combinatorial Distribution Shift: A Matrix Completion Perspective COLT 2023 Understanding Multimodal Contrastive Learning and Incorporating Unpaired Data AISTATS 2023 Addressing token uniformity in transformers via singular value transformation UAI 2022 Biological Learning of Irreducible Representations of Commuting Transformations NeurIPS 2022