conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

Training Trajectories of Language Models Across Scales ACL 2023
Complexity-Guided Slimmable Decoder for Efficient Deep Video Compression CVPR 2023
GradMA: A Gradient-Memory-Based Accelerated Federated Learning With Alleviated Catastrophic Forgetting CVPR 2023
SAMP: A Model Inference Toolkit of Post-Training Quantization for Text Processing via Self-Adaptive Mixed-Precision EMNLP 2023
ActMAD: Activation Matching To Align Distributions for Test-Time-Training CVPR 2023
Network Expansion for Practical Training Acceleration CVPR 2023
One Wide Feedforward Is All You Need EMNLP 2023
YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors CVPR 2023
DOT: A Distillation-Oriented Trainer ICCV 2023
Pruning Parameterization With Bi-Level Optimization for Efficient Semantic Segmentation on the Edge CVPR 2023
Joint Token Pruning and Squeezing Towards More Aggressive Compression of Vision Transformers CVPR 2023
DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network CVPR 2023
Robust Generalization Against Photon-Limited Corruptions via Worst-Case Sharpness Minimization CVPR 2023
CowClip: Reducing CTR Prediction Model Training Time from 12 Hours to 10 Minutes on 1 GPU AAAI 2023
DepGraph: Towards Any Structural Pruning CVPR 2023
AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks AAAI 2023
MultiAdam: Parameter-wise Scale-invariant Optimizer for Multiscale Training of Physics-informed Neural Networks ICML 2023
ESL-SNNs: An Evolutionary Structure Learning Strategy for Spiking Neural Networks AAAI 2023
Implicit Stochastic Gradient Descent for Training Physics-Informed Neural Networks AAAI 2023
Beyond NaN: Resiliency of Optimization Layers in the Face of Infeasibility AAAI 2023
Fixed-Weight Difference Target Propagation AAAI 2023
SPT: Learning to Selectively Insert Prompts for Better Prompt Tuning EMNLP 2023
On Enhancing Fine-Tuning for Pre-trained Language Models EMNLP 2023
Improved Logical Reasoning of Language Models via Differentiable Symbolic Programming ACL 2023
TLM: Token-Level Masking for Transformers EMNLP 2023