parameter efficiency

Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules EMNLP 2023 Visual Prompt Multi-Modal Tracking CVPR 2023 XiNet: Efficient Neural Networks for tinyML ICCV 2023 A compact transformer-based GAN vocoder Interspeech 2022 Bottleneck Low-rank Transformers for Low-resource Spoken Language Understanding Interspeech 2022 Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling EMNLP 2022 Continual Sequence Generation with Adaptive Compositional Modules ACL 2022 COST-EFF: Collaborative Optimization of Spatial and Temporal Efficiency with Slenderized Multi-exit Language Models EMNLP 2022 CS-CTCSCONV1D: Small footprint speaker verification with channel split time-channel-time separable 1-dimensional convolution Interspeech 2022 Deep Network Approximation in Terms of Intrinsic Parameters ICML 2022 Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models Interspeech 2022 DEMix Layers: Disentangling Domains for Modular Language Modeling NAACL 2022 Domain Specific Sub-network for Multi-Domain Neural Machine Translation AACL 2022 DyConvMixer: Dynamic Convolution Mixer Architecture for Open-Vocabulary Keyword Spotting Interspeech 2022 DyRep: Bootstrapping Training With Dynamic Re-Parameterization CVPR 2022 Efficient Learning of Multiple NLP Tasks via Collective Weight Factorization on BERT NAACL 2022 Exploiting Redundancy: Separable Group Convolutional Networks on Lie Groups ICML 2022 Exploring extreme parameter compression for pre-trained language models ICLR 2022 Feature Distillation Interaction Weighting Network for Lightweight Image Super-resolution AAAI 2022 FiE: Building a Global Probability Space by Leveraging Early Fusion in Encoder for Open-Domain Question Answering EMNLP 2022 Fine-Tuning Pre-Trained Language Models Effectively by Optimizing Subnetworks Adaptively NeurIPS 2022 From Fully Trained to Fully Random Embeddings: Improving Neural Machine Translation with Compact Word Embedding Tables AAAI 2022 FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metrics for Automatic Text Generation ACL 2022 GLaM: Efficient Scaling of Language Models with Mixture-of-Experts ICML 2022 Go Wider Instead of Deeper AAAI 2022