conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum Optimizers ICML 2023
CowClip: Reducing CTR Prediction Model Training Time from 12 Hours to 10 Minutes on 1 GPU AAAI 2023
Acceleration of Large Transformer Model Training by Sensitivity-Based Layer Dropping AAAI 2023
ATFormer: A Learned Performance Model with Transfer Learning Across Devices for Deep Learning Tensor Programs EMNLP 2023
AAAI New Faculty Highlights: General and Scalable Optimization for Robust AI AAAI 2023
HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts EMNLP 2023
DMIS: Dynamic Mesh-Based Importance Sampling for Training Physics-Informed Neural Networks AAAI 2023
Bi-Level Meta-Learning for Few-Shot Domain Generalization CVPR 2023
Finite-Sample Analysis of Learning High-Dimensional Single ReLU Neuron ICML 2023
Flatness-Aware Minimization for Domain Generalization ICCV 2023
Linear Regularizers Enforce the Strict Saddle Property AAAI 2023
Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Models NIPS 2023
Training Quantised Neural Networks With STE Variants: The Additive Noise Annealing Algorithm CVPR 2022
DN-DETR: Accelerate DETR Training by Introducing Query DeNoising CVPR 2022
Channel Pruning via Lookahead Search Guided Reinforcement Learning WACV 2022
CHEX: CHannel EXploration for CNN Model Compression CVPR 2022
Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers ICML 2022
Efficient Riemannian Meta-Optimization by Implicit Differentiation AAAI 2022
Delving Into the Estimation Shift of Batch Normalization in a Network CVPR 2022
Brain-Inspired Multilayer Perceptron With Spiking Neurons CVPR 2022
DAQ: Channel-Wise Distribution-Aware Quantization for Deep Image Super-Resolution Networks WACV 2022
Deep Optimization Prior for THz Model Parameter Estimation WACV 2022
Non-Iterative Recovery From Nonlinear Observations Using Generative Models CVPR 2022
Fire Together Wire Together: A Dynamic Pruning Approach With Self-Supervised Mask Prediction CVPR 2022
On the Practical Robustness of the Nesterov’s Accelerated Quasi-Newton Method AAAI 2022