conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

Combating the instability of mutual information-based losses via regularization UAI 2022
PATS: Sensitivity-aware Noisy Learning for Pretrained Language Models EMNLP 2022
Continual Learning with Guarantees via Weight Interval Constraints ICML 2022
Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments EMNLP 2022
Accelerating Sparse Convolution with Column Vector-Wise Sparsity NIPS 2022
Dynamic Group Transformer: A General Vision Transformer Backbone with Dynamic Group Attention IJCAI 2022
Exponentially Improving the Complexity of Simulating the Weisfeiler-Lehman Test with Graph Neural Networks NIPS 2022
A Closer Look at the Adversarial Robustness of Deep Equilibrium Models NIPS 2022
TREC: Transient Redundancy Elimination-based Convolution NIPS 2022
Efficient Training of Low-Curvature Neural Networks NIPS 2022
Deep Active Learning by Leveraging Training Dynamics NIPS 2022
Reasoning over Hybrid Chain for Table-and-Text Open Domain Question Answering IJCAI 2022
Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit NIPS 2022
Instability and Local Minima in GAN Training with Kernel Discriminators NIPS 2022
A Solver + Gradient Descent Training Algorithm for Deep Neural Networks IJCAI 2022
LOT: Layer-wise Orthogonal Training on Improving l2 Certified Robustness NIPS 2022
To Fold or Not to Fold: a Necessary and Sufficient Condition on Batch-Normalization Layers Folding IJCAI 2022
Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape AISTATS 2022
DiagViB-6: A Diagnostic Benchmark Suite for Vision Models in the Presence of Shortcut and Generalization Opportunities ICCV 2021
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning AAAI 2021
Adaptive Proximal Gradient Methods for Structured Neural Networks NIPS 2021
Post-training Quantization with Multiple Points: Mixed Precision without Mixed Precision AAAI 2021
calibrated adversarial training ACML 2021
Accelerating Gossip SGD with Periodic Global Averaging ICML 2021
Catformer: Designing Stable Transformers via Sensitivity Analysis ICML 2021