weight matrix

An Orthogonal High-Rank Adaptation for Large Language Models EMNLP 2025 Basis Sharing: Cross-Layer Parameter Sharing for Large Language Model Compression ICLR 2025 Breaking Free from MMI: A New Frontier in Rationalization by Probing Input Utilization ICLR 2025 Dobi-SVD: Differentiable SVD for LLM Compression and Some New Perspectives ICLR 2025 DOCS: Quantifying Weight Similarity for Deeper Insights into Large Language Models ICLR 2025 ProcrustesGPT: Compressing LLMs with Structured Matrices and Orthogonal Transformations ACL 2025 When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time? AISTATS 2025 AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models NeurIPS 2024 BLAST: Block-Level Adaptive Structured Matrices for Efficient Deep Neural Network Inference NeurIPS 2024 Cascade of phase transitions in the training of energy-based models NeurIPS 2024 Differentiable Learning of Generalized Structured Matrices for Efficient Deep Neural Networks ICLR 2024 Efficient Low-Dimensional Compression of Overparameterized Models AISTATS 2024 Koopman-based generalization bound: New aspect for full-rank weights ICLR 2024 OneBit: Towards Extremely Low-bit Large Language Models NeurIPS 2024 Preventing Dimensional Collapse in Self-Supervised Learning via Orthogonality Regularization NeurIPS 2024 Reweighted Solutions for Weighted Low Rank Approximation ICML 2024 The Expressive Power of Low-Rank Adaptation ICLR 2024 Exploring Linguistic Properties of Monolingual BERTs with Typological Classification among Languages EMNLP 2023 How Powerful are Shallow Neural Networks with Bandlimited Random Weights? ICML 2023 Implicit Regularization Towards Rank Minimization in ReLU Networks ALT 2023 LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation ICML 2023 Low Tensor Rank Learning of Neural Dynamics NeurIPS 2023 Transformers learn through gradual rank increase NeurIPS 2023 Learning Pruning-Friendly Networks via Frank-Wolfe: One-Shot, Any-Sparsity, And No Retraining ICLR 2022 Operative dimensions in unconstrained connectivity of recurrent neural networks NeurIPS 2022