conftrace_

overfitting reduction

9 papers

Explore in graph

Co-occurring keywords

overfitting prevention (29) deep neural network (1803) knowledge distillation (3725) lifelong benchmark (1) compute efficiency (19) parameter efficiency (417) small dataset (13) inference cost (28) foundation model alignment (2) query synthesis (4)

Papers

Instruction Tuning With Loss Over Instructions NIPS 2024
IR2: Information Regularization for Information Retrieval COLING 2024
Efficient Lifelong Model Evaluation in an Era of Rapid Progress NIPS 2024
Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm ACL 2022
Knowledge Evolution in Neural Networks CVPR 2021
Low Curvature Activations Reduce Overfitting in Adversarial Training ICCV 2021
MergeNAS: Merge Operations into One for Differentiable Architecture Search IJCAI 2020
LDMNet: Low Dimensional Manifold Regularized Neural Networks CVPR 2018
GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks ICML 2018