conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

Squashed Weight Distribution for Low Bit Quantization of Deep Models INTERSPEECH 2022
Conditionally Gaussian PAC-Bayes AISTATS 2022
Optimal channel selection with discrete QCQP AISTATS 2022
Deep Optimization Prior for THz Model Parameter Estimation WACV 2022
Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach NIPS 2022
On global convergence of ResNets: From finite to infinite width using linear parameterization NIPS 2022
Implicit Gradient Alignment in Distributed and Federated Learning AAAI 2022
Signal Recovery with Non-Expansive Generative Network Priors NIPS 2022
Less Is More: Pay Less Attention in Vision Transformers AAAI 2022
JFB: Jacobian-Free Backpropagation for Implicit Networks AAAI 2022
Scalable and Efficient Training of Large Convolutional Neural Networks with Differential Privacy NIPS 2022
Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks COLING 2022
Improving Stability of Fine-Tuning Pretrained Language Models via Component-Wise Gradient Norm Clipping EMNLP 2022
Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo CVPR 2022
Towards Efficient and Scalable Sharpness-Aware Minimization CVPR 2022
RIGA at SemEval-2022 Task 1: Scaling Recurrent Neural Networks for CODWOE Dictionary Modeling SEMEVAL 2022
Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers ICML 2022
Modify Self-Attention via Skeleton Decomposition for Effective Point Cloud Transformer AAAI 2022
KOALA: A Kalman Optimization Algorithm with Loss Adaptivity AAAI 2022
Fractional Adaptive Linear Units AAAI 2022
Rethinking Influence Functions of Neural Networks in the Over-Parameterized Regime AAAI 2022
DAQ: Channel-Wise Distribution-Aware Quantization for Deep Image Super-Resolution Networks WACV 2022
Chaotic Dynamics are Intrinsic to Neural Network Training with SGD NIPS 2022
Spectral Bias in Practice: The Role of Function Frequency in Generalization NIPS 2022
Improving Transformer with an Admixture of Attention Heads NIPS 2022