conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

Rethinking Weight Decay for Robust Fine-Tuning of Foundation Models NIPS 2024
Analyzing Generalization in Policy Networks: A Case Study with the Double-Integrator System AAAI 2024
Speed of Light Exact Greedy Decoding for RNN-T Speech Recognition Models on GPU INTERSPEECH 2024
The Orthogonality of Weight Vectors: The Key Characteristics of Normalization and Residual Connections IJCAI 2024
A provable control of sensitivity of neural networks through a direct parameterization of the overall bi-Lipschitzness NIPS 2024
Physics-Informed Neural Networks: Minimizing Residual Loss with Wide Networks and Effective Activations IJCAI 2024
Sparse Binarization for Fast Keyword Spotting INTERSPEECH 2024
Understanding the difficulty of solving Cauchy problems with PINNs L4DC 2024
Lightweight Transducer Based on Frame-Level Criterion INTERSPEECH 2024
Improving Equivariant Model Training via Constraint Relaxation NIPS 2024
Parameter-free Clipped Gradient Descent Meets Polyak NIPS 2024
CR-SAM: Curvature Regularized Sharpness-Aware Minimization AAAI 2024
Understanding and Improving Optimization in Predictive Coding Networks AAAI 2024
X-former Elucidator: Reviving Efficient Attention for Long Context Language Modeling IJCAI 2024
Weight-Inherited Distillation for Task-Agnostic BERT Compression NAACL 2024
GRAWA: Gradient-based Weighted Averaging for Distributed Training of Deep Learning Models AISTATS 2024
Uncertainty Regularized Evidential Regression AAAI 2024
A two-scale Complexity Measure for Deep Learning Models NIPS 2024
Rethinking 3D Convolution in $\ell_p$-norm Space NIPS 2024
BadRL: Sparse Targeted Backdoor Attack against Reinforcement Learning AAAI 2024
AutoAugment Is What You Need: Enhancing Rule-based Augmentation Methods in Low-resource Regimes EACL 2024
Memory-Efficient LLM Training with Online Subspace Descent NIPS 2024
Layer Collaboration in the Forward-Forward Algorithm AAAI 2024
Preparing Lessons for Progressive Training on Language Models AAAI 2024
SynSP: Synergy of Smoothness and Precision in Pose Sequences Refinement CVPR 2024