conftrace_

neural network optimization

1293 papers

Explore in graph

Co-occurring keywords

model compression (3302) neural network (6616) convolutional neural network (4226) gradient descent (1144) stochastic gradient descent (1091) efficient computing (781) deep neural network (1803) large language model (13587) knowledge distillation (3725) representation learning (6206)

Papers

A Single Linear Layer Yields Task-Adapted Low-Rank Matrices COLING 2024
DiffLoc: Diffusion Model for Outdoor LiDAR Localization CVPR 2024
Improving Training Efficiency of Diffusion Models via Multi-Stage Framework and Tailored Multi-Decoder Architecture CVPR 2024
From Activation to Initialization: Scaling Insights for Optimizing Neural Fields CVPR 2024
A Structure-Aware Framework for Learning Device Placements on Computation Graphs NIPS 2024
AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models ACL 2024
Memory-Efficient LLM Training with Online Subspace Descent NIPS 2024
PINNacle: A Comprehensive Benchmark of Physics-Informed Neural Networks for Solving PDEs NIPS 2024
OptEx: Expediting First-Order Optimization with Approximately Parallelized Iterations NIPS 2024
In-context Learning and Gradient Descent Revisited NAACL 2024
SPIN: Sparsifying and Integrating Internal Neurons in Large Language Models for Text Classification ACL 2024
RA-LoRA: Rank-Adaptive Parameter-Efficient Fine-Tuning for Accurate 2-bit Quantized Large Language Models ACL 2024
BOLD: Boolean Logic Deep Learning NIPS 2024
ReCaLL: Membership Inference via Relative Conditional Log-Likelihoods EMNLP 2024
Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training NIPS 2024
The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks NIPS 2024
Rethinking Pruning Large Language Models: Benefits and Pitfalls of Reconstruction Error Minimization EMNLP 2024
Clarifying the Behavior and the Difficulty of Adversarial Training AAAI 2024
Layer Compression of Deep Networks with Straight Flows AAAI 2024
Scaling Laws in Linear Regression: Compute, Parameters, and Data NIPS 2024
$\boldsymbol{\mu}\mathbf{P^2}$: Effective Sharpness Aware Minimization Requires Layerwise Perturbation Scaling NIPS 2024
PTQ4DiT: Post-training Quantization for Diffusion Transformers NIPS 2024
DSD²: Can We Dodge Sparse Double Descent and Compress the Neural Network Worry-Free? AAAI 2024
Uncertainty Regularized Evidential Regression AAAI 2024
Taxonomy Driven Fast Adversarial Training AAAI 2024