conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

M³ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design NIPS 2022
To update or not to update? Neurons at equilibrium in deep models NIPS 2022
Deep Non-crossing Quantiles through the Partial Derivative AISTATS 2022
CHEX: CHannel EXploration for CNN Model Compression CVPR 2022
Delving Into the Estimation Shift of Batch Normalization in a Network CVPR 2022
Brain-Inspired Multilayer Perceptron With Spiking Neurons CVPR 2022
Overparameterization of Deep ResNet: Zero Loss and Mean-field Analysis JMLR 2022
Training Quantised Neural Networks With STE Variants: The Additive Noise Annealing Algorithm CVPR 2022
Globally Gated Deep Linear Networks NIPS 2022
RNNs of RNNs: Recursive Construction of Stable Assemblies of Recurrent Neural Networks NIPS 2022
Understanding Deep Contrastive Learning via Coordinate-wise Optimization NIPS 2022
Implicit Regularization with Polynomial Growth in Deep Tensor Factorization ICML 2022
SDQ: Stochastic Differentiable Quantization with Mixed Precision ICML 2022
Fast Finite Width Neural Tangent Kernel ICML 2022
Optimal Clipping and Magnitude-aware Differentiation for Improved Quantization-aware Training ICML 2022
Convergence Rates of Non-Convex Stochastic Gradient Descent Under a Generic Lojasiewicz Condition and Local Smoothness ICML 2022
Three-stage Evolution and Fast Equilibrium for SGD with Non-degerate Critical Points ICML 2022
ShiftAddNAS: Hardware-Inspired Search for More Accurate and Efficient Neural Networks ICML 2022
Penalizing Gradient Norm for Efficiently Improving Generalization in Deep Learning ICML 2022
DN-DETR: Accelerate DETR Training by Introducing Query DeNoising CVPR 2022
HoD-Net: High-Order Differentiable Deep Neural Networks and Applications AAAI 2022
Non-Iterative Recovery From Nonlinear Observations Using Generative Models CVPR 2022
It's All in the Teacher: Zero-Shot Quantization Brought Closer to the Teacher CVPR 2022
PokeBNN: A Binary Pursuit of Lightweight Accuracy CVPR 2022
On the SDEs and Scaling Rules for Adaptive Gradient Algorithms NIPS 2022