conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

Learning to Optimize: A Primer and A Benchmark JMLR 2022
Contrastive Dual Gating: Learning Sparse Features With Contrastive Learning CVPR 2022
HODEC: Towards Efficient High-Order DEcomposed Convolutional Neural Networks CVPR 2022
Warmstart Approach for Accelerating Deep Image Prior Reconstruction in Dynamic Tomography MIDL 2022
Predicting Attention Sparsity in Transformers ACL 2022
Automated Progressive Learning for Efficient Training of Vision Transformers CVPR 2022
Efficient Riemannian Meta-Optimization by Implicit Differentiation AAAI 2022
On the Practical Robustness of the Nesterov’s Accelerated Quasi-Newton Method AAAI 2022
Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency ACL 2022
A Gentle Introduction to Deep Nets and Opportunities for the Future ACL 2022
A Simple Hash-Based Early Exiting Approach For Language Understanding and Generation ACL 2022
ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generation ACL 2022
Attention Mechanism with Energy-Friendly Operations ACL 2022
Anticipation-Free Training for Simultaneous Machine Translation ACL 2022
Stochastic Adaptive Activation Function NIPS 2022
Is Integer Arithmetic Enough for Deep Learning Training? NIPS 2022
PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategies NIPS 2022
Beyond Cross-View Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image CVPR 2022
Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning NIPS 2022
DyRep: Bootstrapping Training With Dynamic Re-Parameterization CVPR 2022
Walle: An End-to-End, General-Purpose, and Large-Scale Production System for Device-Cloud Collaborative Machine Learning OSDI 2022
Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimation ICML 2022
GA-SAM: Gradient-Strength based Adaptive Sharpness-Aware Minimization for Improved Generalization EMNLP 2022
Exploring Mode Connectivity for Pre-trained Language Models EMNLP 2022
FPT: Improving Prompt Tuning Efficiency via Progressive Training EMNLP 2022