conftrace_

parameter efficiency

417 papers

Explore in graph

Co-occurring keywords

model compression (3302) transfer learning (5449) convolutional neural network (4226) large language model (13587) mixture of expert (640) knowledge distillation (3725) neural network (6616) language model (4599) neural network optimization (1293) efficient computing (781)

Papers

Compressing 1D Time-Channel Separable Convolutions Using Sparse Random Ternary Matrices INTERSPEECH 2021
FP-NAS: Fast Probabilistic Neural Architecture Search CVPR 2021
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation EMNLP 2021
Shapeshifter: a Parameter-efficient Transformer using Factorized Reshaped Matrices NIPS 2021
Pruning Randomly Initialized Neural Networks with Iterative Randomization NIPS 2021
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning IJCNLP 2021
Extremely Low Footprint End-to-End ASR System for Smart Device INTERSPEECH 2021
Cascaded Head-colliding Attention ACL 2021
Sparse Uncertainty Representation in Deep Learning with Inducing Weights NIPS 2021
Efficient Feature Transformations for Discriminative and Generative Continual Learning CVPR 2021
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning ACL 2021
BinaryBERT: Pushing the Limit of BERT Quantization IJCNLP 2021
Prefix-Tuning: Optimizing Continuous Prompts for Generation IJCNLP 2021
Importance-based Neuron Allocation for Multilingual Neural Machine Translation ACL 2021
Multi-stage Pre-training over Simplified Multimodal Pre-training Models IJCNLP 2021
Scaling Local Self-Attention for Parameter Efficient Visual Backbones CVPR 2021
Training Graph Neural Networks with 1000 Layers ICML 2021
Towards Extremely Compact RNNs for Video Recognition With Fully Decomposed Hierarchical Tucker Structure CVPR 2021
Task Switching Network for Multi-Task Learning ICCV 2021
Channel Permutations for N:M Sparsity NIPS 2021
BabyBERTa: Learning More Grammar With Small-Scale Child-Directed Language EMNLP 2021
Partially-Connected Differentiable Architecture Search for Deepfake and Spoofing Detection INTERSPEECH 2021
Chasing Sparsity in Vision Transformers: An End-to-End Exploration NIPS 2021
Continuous Self-Attention Models with Neural ODE Networks AAAI 2021
DTMNet: A Discrete Tchebichef Moments-Based Deep Neural Network for Multi-Focus Image Fusion ICCV 2021