conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

BOLD: Boolean Logic Deep Learning NIPS 2024
PTQ4DiT: Post-training Quantization for Diffusion Transformers NIPS 2024
Unveiling The Matthew Effect Across Channels: Assessing Layer Width Sufficiency via Weight Norm Variance NIPS 2024
Physics-Informed Neural Networks: Minimizing Residual Loss with Wide Networks and Effective Activations IJCAI 2024
Scaling Laws in Linear Regression: Compute, Parameters, and Data NIPS 2024
OptEx: Expediting First-Order Optimization with Approximately Parallelized Iterations NIPS 2024
The Price of Implicit Bias in Adversarially Robust Generalization NIPS 2024
Understanding and Minimising Outlier Features in Transformer Training NIPS 2024
Where Do Large Learning Rates Lead Us? NIPS 2024
Rethinking Weight Decay for Robust Fine-Tuning of Foundation Models NIPS 2024
Causality-enhanced Discreted Physics-informed Neural Networks for Predicting Evolutionary Equations IJCAI 2024
Provably Transformers Harness Multi-Concept Word Semantics for Efficient In-Context Learning NIPS 2024
The Orthogonality of Weight Vectors: The Key Characteristics of Normalization and Residual Connections IJCAI 2024
On the Unstable Convergence Regime of Gradient Descent AAAI 2024
X-former Elucidator: Reviving Efficient Attention for Long Context Language Modeling IJCAI 2024
Dynamic Neural Regeneration: Enhancing Deep Learning Generalization on Small Datasets NIPS 2024
Structured Pruning for Large Language Models Using Coupled Components Elimination and Minor Fine-tuning NAACL 2024
Adaptive Depth Networks with Skippable Sub-Paths NIPS 2024
Lossless Acceleration of Large Language Model via Adaptive N-gram Parallel Decoding NAACL 2024
Enhancing Non-Matching Reference Speech Quality Assessment through Dynamic Weight Adaptation INTERSPEECH 2024
Analyzing Generalization in Policy Networks: A Case Study with the Double-Integrator System AAAI 2024
Speed of Light Exact Greedy Decoding for RNN-T Speech Recognition Models on GPU INTERSPEECH 2024
SOI: Scaling Down Computational Complexity by Estimating Partial States of the Model NIPS 2024
A Layer-Wise Natural Gradient Optimizer for Training Deep Neural Networks NIPS 2024
Lightweight Transducer Based on Frame-Level Criterion INTERSPEECH 2024