conftrace_

singular value decomposition

222 papers

Explore in graph

Also known as

SVD

Co-occurring keywords

model compression (3302) low-rank approximation (323) matrix factorization (529) low-rank adaptation (560) matrix completion (356) representation learning (6206) dimensionality reduction (720) convex optimization (1321) parameter-efficient fine-tuning (736) word embedding (1764)

Papers

Talking Heads: Understanding Inter-Layer Communication in Transformer Language Models NIPS 2024
HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models CVPR 2024
Generalized Tensor Decomposition for Understanding Multi-Output Regression under Combinatorial Shifts NIPS 2024
Enhancing Translation Ability of Large Language Models by Leveraging Task-Related Layers COLING 2024
On Differentially Private Subspace Estimation in a Distribution-Free Setting NIPS 2024
Compensate Quantization Errors: Make Weights Hierarchical to Compensate Each Other NAACL 2024
SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors NIPS 2024
Spectral Filters, Dark Signals, and Attention Sinks ACL 2024
Spectral Adapter: Fine-Tuning in Spectral Space NIPS 2024
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning NIPS 2024
Understanding Multimodal Contrastive Learning and Incorporating Unpaired Data AISTATS 2023
Efficient Robust Principal Component Analysis via Block Krylov Iteration and CUR Decomposition CVPR 2023
Global Explanations for Image Classifiers (Student Abstract) AAAI 2023
Tackling Combinatorial Distribution Shift: A Matrix Completion Perspective COLT 2023
Singular Value Representation: A New Graph Perspective On Neural Networks AISTATS 2023
SVD-DIP: Overcoming the Overfitting Problem in DIP-based CT Reconstruction MIDL 2023
Residual Alignment: Uncovering the Mechanisms of Residual Networks NIPS 2023
LightFormer: Light-weight Transformer Using SVD-based Weight Transfer and Parameter Sharing ACL 2023
Singularformer: Learning to Decompose Self-Attention to Linearize the Complexity of Transformer IJCAI 2023
Representations and Exploration for Deep Reinforcement Learning using Singular Value Decomposition ICML 2023
Continual Learning with Scaled Gradient Projection AAAI 2023
On the Power of SVD in the Stochastic Block Model NIPS 2023
Dynamic Low-rank Estimation for Transformer-based Language Models EMNLP 2023
Sampling-based Nyström Approximation and Kernel Quadrature ICML 2023
Primal-Attention: Self-attention through Asymmetric Kernel SVD in Primal Representation NIPS 2023