conftrace_

weight matrix

30 papers

Explore in graph

Co-occurring keywords

model compression (3302) recurrent neural network (1790) neural network (6616) large language model (13587) generative adversarial network (1944) neural network pruning (265) structured pruning (95) orthogonality regularization (9) spectral normalization (19) orthogonal regularization (14)

Papers

An Orthogonal High-Rank Adaptation for Large Language Models EMNLP 2025
ProcrustesGPT: Compressing LLMs with Structured Matrices and Orthogonal Transformations ACL 2025
Preventing Dimensional Collapse in Self-Supervised Learning via Orthogonality Regularization NIPS 2024
BLAST: Block-Level Adaptive Structured Matrices for Efficient Deep Neural Network Inference NIPS 2024
AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models NIPS 2024
OneBit: Towards Extremely Low-bit Large Language Models NIPS 2024
Efficient Low-Dimensional Compression of Overparameterized Models AISTATS 2024
Cascade of phase transitions in the training of energy-based models NIPS 2024
How Powerful are Shallow Neural Networks with Bandlimited Random Weights? ICML 2023
Low Tensor Rank Learning of Neural Dynamics NIPS 2023
Implicit Regularization Towards Rank Minimization in ReLU Networks ALT 2023
Exploring Linguistic Properties of Monolingual BERTs with Typological Classification among Languages EMNLP 2023
Transformers learn through gradual rank increase NIPS 2023
LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation ICML 2023
Operative dimensions in unconstrained connectivity of recurrent neural networks NIPS 2022
Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization NIPS 2022
Spectral Tensor Train Parameterization of Deep Learning Layers AISTATS 2021
Learning Factorized Weight Matrix for Joint Filtering ICML 2020
Learning nonlinear dynamical systems from a single trajectory L4DC 2020
DARB: A Density-Adaptive Regular-Block Pruning for Deep Neural Networks AAAI 2020
Controllable Orthogonalization in Training DNNs CVPR 2020
Structured Pruning of Large Language Models EMNLP 2020
Spectral Regularization for Combating Mode Collapse in GANs ICCV 2019
Stochastic Gradient Descent Learns State Equations with Nonlinear Activations COLT 2019
Traditional and Heavy Tailed Self Regularization in Neural Network Models ICML 2019