conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

AutoAugment Is What You Need: Enhancing Rule-based Augmentation Methods in Low-resource Regimes EACL 2024
BOLD: Boolean Logic Deep Learning NIPS 2024
Understanding the difficulty of solving Cauchy problems with PINNs L4DC 2024
Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference EACL 2024
The Orthogonality of Weight Vectors: The Key Characteristics of Normalization and Residual Connections IJCAI 2024
BMRS: Bayesian Model Reduction for Structured Pruning NIPS 2024
Predictor-Corrector Enhanced Transformers with Exponential Moving Average Coefficient Learning NIPS 2024
DiP-GO: A Diffusion Pruner via Few-step Gradient Optimization NIPS 2024
Stochastic Fine-Tuning of Language Models Using Masked Gradients EMNLP 2024
DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models NIPS 2024
Loss-Curvature Matching for Dataset Selection and Condensation AISTATS 2023
Learning to Boost Training by Periodic Nowcasting Near Future Weights ICML 2023
CowClip: Reducing CTR Prediction Model Training Time from 12 Hours to 10 Minutes on 1 GPU AAAI 2023
Optimistic Meta-Gradients NIPS 2023
FlexRound: Learnable Rounding based on Element-wise Division for Post-Training Quantization ICML 2023
Beyond the Edge of Stability via Two-step Gradient Updates ICML 2023
Mode Connectivity in Auction Design NIPS 2023
FedNAR: Federated Optimization with Normalized Annealing Regularization NIPS 2023
Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum Optimizers ICML 2023
Linear Regularizers Enforce the Strict Saddle Property AAAI 2023
Reinforcement Learning for Branch-and-Bound Optimisation Using Retrospective Trajectories AAAI 2023
ASkewSGD : An Annealed interval-constrained Optimisation method to train Quantized Neural Networks AISTATS 2023
SAM operates far from home: eigenvalue regularization as a dynamical phenomenon ICML 2023
Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Models NIPS 2023
Improving Adversarial Robustness via Information Bottleneck Distillation NIPS 2023