conftrace_

parameter initialization

21 papers

Explore in graph

Co-occurring keywords

transfer learning (5449) few-shot learning (3398) transformer model (1996) neural network optimization (1293) neural machine translation (2310) neural network initialization (33) maxout network (4) large language model (13587) neural network (6616) deep learning (2118)

Papers

Initialization is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing NIPS 2024
Initialization of Large Language Models via Reparameterization to Mitigate Loss Spikes EMNLP 2024
Local to Global: Learning Dynamics and Effect of Initialization for Transformers NIPS 2024
OneBit: Towards Extremely Low-bit Large Language Models NIPS 2024
XB-MAML: Learning Expandable Basis Parameters for Effective Meta-Learning with Wide Task Coverage AISTATS 2024
Initialization-Dependent Sample Complexity of Linear Predictors and Neural Networks NIPS 2023
Expected Gradients of Maxout Networks and Consequences to Parameter Initialization ICML 2023
bert2BERT: Towards Reusable Pretrained Language Models ACL 2022
ConsistTL: Modeling Consistency in Transfer Learning for Low-Resource Neural Machine Translation EMNLP 2022
Information Augmentation for Few-shot Node Classification IJCAI 2022
Few-shot initializing of Active Learner via Meta-Learning EMNLP 2022
Pre-training Methods for Neural Machine Translation ACL 2021
Reducing Neural Network Parameter Initialization Into an SMT Problem (Student Abstract) AAAI 2021
Meta Learning and Its Applications to Natural Language Processing IJCNLP 2021
Meta Distant Transfer Learning for Pre-trained Language Models EMNLP 2021
On the Expected Complexity of Maxout Networks NIPS 2021
Meta Learning and Its Applications to Natural Language Processing ACL 2021
Lipschitz Constrained Parameter Initialization for Deep Transformers ACL 2020
Transfer and Multi-Task Learning for Noun–Noun Compound Interpretation EMNLP 2018
Improved Neural Network Initialization by Grouping Context-Dependent Targets for Acoustic Modeling INTERSPEECH 2016
Ensemble Learning for Multi-Source Neural Machine Translation COLING 2016