conftrace_

parameter efficiency

417 papers

Explore in graph

Co-occurring keywords

model compression (3302) transfer learning (5449) convolutional neural network (4226) large language model (13587) mixture of expert (640) knowledge distillation (3725) neural network (6616) language model (4599) neural network optimization (1293) efficient computing (781)

Papers

A compact transformer-based GAN vocoder INTERSPEECH 2022
Bottleneck Low-rank Transformers for Low-resource Spoken Language Understanding INTERSPEECH 2022
CS-CTCSCONV1D: Small footprint speaker verification with channel split time-channel-time separable 1-dimensional convolution INTERSPEECH 2022
ShuffleMixer: An Efficient ConvNet for Image Super-Resolution NIPS 2022
Recent Advances in Pre-trained Language Models: Why Do They Work and How Do They Work IJCNLP 2022
Deep Network Approximation in Terms of Intrinsic Parameters ICML 2022
Multi-Path Transformer is Better: A Case Study on Neural Machine Translation EMNLP 2022
From Fully Trained to Fully Random Embeddings: Improving Neural Machine Translation with Compact Word Embedding Tables AAAI 2022
Feature Distillation Interaction Weighting Network for Lightweight Image Super-resolution AAAI 2022
Streaming Automatic Speech Recognition with Re-blocking Processing Based on Integrated Voice Activity Detection INTERSPEECH 2022
SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters EMNLP 2022
COST-EFF: Collaborative Optimization of Spatial and Temporal Efficiency with Slenderized Multi-exit Language Models EMNLP 2022
Multilingual Machine Translation with Hyper-Adapters EMNLP 2022
P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks ACL 2022
MoEfication: Transformer Feed-forward Layers are Mixtures of Experts ACL 2022
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metrics for Automatic Text Generation ACL 2022
Modular and Parameter-Efficient Multimodal Fusion with Prompting ACL 2022
Parameter-Efficient Conformers via Sharing Sparsely-Gated Experts for End-to-End Speech Recognition INTERSPEECH 2022
Efficient Learning of Multiple NLP Tasks via Collective Weight Factorization on BERT NAACL 2022
To update or not to update? Neurons at equilibrium in deep models NIPS 2022
Log-Polar Space Convolution Layers NIPS 2022
Fine-Tuning Pre-Trained Language Models Effectively by Optimizing Subnetworks Adaptively NIPS 2022
Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling EMNLP 2022
Exploiting Redundancy: Separable Group Convolutional Networks on Lie Groups ICML 2022
FiE: Building a Global Probability Space by Leveraging Early Fusion in Encoder for Open-Domain Question Answering EMNLP 2022