conftrace_

parameter efficiency

417 papers

Explore in graph

Co-occurring keywords

model compression (3302) transfer learning (5449) convolutional neural network (4226) large language model (13587) mixture of expert (640) knowledge distillation (3725) neural network (6616) language model (4599) neural network optimization (1293) efficient computing (781)

Papers

HashFormers: Towards Vocabulary-independent Pre-trained Transformers EMNLP 2022
Towards Simple and Efficient Task-Adaptive Pre-training for Text Classification AACL 2022
Domain Specific Sub-network for Multi-Domain Neural Machine Translation AACL 2022
LayerConnect: Hypernetwork-Assisted Inter-Layer Connector to Enhance Parameter Efficiency COLING 2022
Dense for the Price of Sparse: Improved Performance of Sparsely Initialized Networks via a Subspace Offset ICML 2021
Cascaded Head-colliding Attention IJCNLP 2021
It’s Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners NAACL 2021
Lightweight Adapter Tuning for Multilingual Speech Translation ACL 2021
Benchmarking a transformer-FREE model for ad-hoc retrieval EACL 2021
AdapterDrop: On the Efficiency of Adapters in Transformers EMNLP 2021
PDO-eS2CNNs: Partial Differential Operator Based Equivariant Spherical CNNs AAAI 2021
BERT might be Overkill: A Tiny but Effective Biomedical Entity Linker based on Residual Convolutional Neural Networks EMNLP 2021
Counter-Interference Adapter for Multilingual Machine Translation EMNLP 2021
Neural Network Surgery: Injecting Data Patterns into Pre-trained Models with Minimal Instance-wise Side Effects NAACL 2021
Optimizing Reusable Knowledge for Continual Learning via Metalearning NIPS 2021
CAM-GAN: Continual Adaptation Modules for Generative Adversarial Networks NIPS 2021
Multilingual Speech Translation from Efficient Finetuning of Pretrained Models ACL 2021
LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search CVPR 2021
Multi-Path Neural Networks for On-Device Multi-Domain Visual Classification WACV 2021
Deep Continuous Networks ICML 2021
EfficientNetV2: Smaller Models and Faster Training ICML 2021
Efficient Equivariant Network NIPS 2021
Efficient Weight Factorization for Multilingual Speech Recognition INTERSPEECH 2021
Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference EMNLP 2021
Subformer: Exploring Weight Sharing for Parameter Efficiency in Generative Transformers EMNLP 2021