weight tying

Headless Language Models: Learning without Predicting with Contrastive Weight Tying ICLR 2024 Tied-LoRA: Enhancing parameter efficiency of LoRA with Weight Tying NAACL 2024 Global Convergence of Over-parameterized Deep Equilibrium Models AISTATS 2023 Tied & Reduced RNN-T Decoder Interspeech 2021 Training Graph Neural Networks with 1000 Layers ICML 2021 Joey NMT: A Minimalist NMT Toolkit for Novices EMNLP 2019 Learning to Convolve: A Generalized Weight-Tying Approach ICML 2019 Representation Degeneration Problem in Training Natural Language Generation Models ICLR 2019 Beyond Weight Tying: Learning Joint Input-Output Embeddings for Neural Machine Translation EMNLP 2018 Reproducing and Regularizing the SCRN Model COLING 2018 Using the Output Embedding to Improve Language Models EACL 2017 Tiled convolutional neural networks NeurIPS 2010