conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

SPIN: Sparsifying and Integrating Internal Neurons in Large Language Models for Text Classification ACL 2024
RA-LoRA: Rank-Adaptive Parameter-Efficient Fine-Tuning for Accurate 2-bit Quantized Large Language Models ACL 2024
AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models ACL 2024
MQuinE: a Cure for “Z-paradox” in Knowledge Graph Embedding EMNLP 2024
On the Power of Small-size Graph Neural Networks for Linear Programming NIPS 2024
Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions JMLR 2024
DSD²: Can We Dodge Sparse Double Descent and Compress the Neural Network Worry-Free? AAAI 2024
On the Limitations of Fractal Dimension as a Measure of Generalization NIPS 2024
Uncertainty Regularized Evidential Regression AAAI 2024
On the Inductive Bias of Stacking Towards Improving Reasoning NIPS 2024
The Expected Loss of Preconditioned Langevin Dynamics Reveals the Hessian Rank AAAI 2024
Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training NIPS 2024
Evolution and learning in differentiable robots RSS 2024
Weight-Inherited Distillation for Task-Agnostic BERT Compression NAACL 2024
Understanding the difficulty of solving Cauchy problems with PINNs L4DC 2024
Layer Compression of Deep Networks with Straight Flows AAAI 2024
The Role of Over-Parameterization in Machine Learning – the Good, the Bad, the Ugly AAAI 2024
SHAP-EDITOR: Instruction-Guided Latent 3D Editing in Seconds CVPR 2024
Boosting Adversarial Transferability by Block Shuffle and Rotation CVPR 2024
Generalizable and Stable Finetuning of Pretrained Language Models on Low-Resource Texts NAACL 2024
Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent NIPS 2024
The Impact of Depth on Compositional Generalization in Transformer Language Models NAACL 2024
Empowering Resampling Operation for Ultra-High-Definition Image Enhancement with Model-Aware Guidance CVPR 2024
Analyzing and Improving the Training Dynamics of Diffusion Models CVPR 2024
ResLoRA: Identity Residual Mapping in Low-Rank Adaption ACL 2024