parameter efficiency

HashFormers: Towards Vocabulary-independent Pre-trained Transformers EMNLP 2022 Hyper-Convolution Networks for Biomedical Image Segmentation WACV 2022 HyperPrompt: Prompt-based Task-Conditioning of Transformers ICML 2022 Hypoformer: Hybrid Decomposition Transformer for Edge-friendly Neural Machine Translation EMNLP 2022 Implicit Feature Decoupling With Depthwise Quantization CVPR 2022 Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models EMNLP 2022 KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation NAACL 2022 LayerConnect: Hypernetwork-Assisted Inter-Layer Connector to Enhance Parameter Efficiency COLING 2022 Log-Polar Space Convolution Layers NeurIPS 2022 MiniViT: Compressing Vision Transformers With Weight Multiplexing CVPR 2022 Modular and Parameter-Efficient Multimodal Fusion with Prompting ACL 2022 MoEfication: Transformer Feed-forward Layers are Mixtures of Experts ACL 2022 Multilingual Machine Translation with Hyper-Adapters EMNLP 2022 Multi-Path Transformer is Better: A Case Study on Neural Machine Translation EMNLP 2022 NomMer: Nominate Synergistic Context in Vision Transformer for Visual Recognition CVPR 2022 Parameter-Efficient Conformers via Sharing Sparsely-Gated Experts for End-to-End Speech Recognition Interspeech 2022 Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models COLING 2022 Parameter-Efficient Sparsity for Large Language Models Fine-Tuning IJCAI 2022 PLATO-Ad: A Unified Advertisement Text Generation Framework with Multi-Task Prompt Learning EMNLP 2022 P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks ACL 2022 Recent Advances in Pre-trained Language Models: Why Do They Work and How Do They Work AACL 2022 RSTT: Real-Time Spatial Temporal Transformer for Space-Time Video Super-Resolution CVPR 2022 Scale Efficiently: Insights from Pretraining and Finetuning Transformers ICLR 2022 ShuffleMixer: An Efficient ConvNet for Image Super-Resolution NeurIPS 2022 SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters EMNLP 2022