conftrace_

parameter efficiency

417 papers

Explore in graph

Co-occurring keywords

model compression (3302) transfer learning (5449) convolutional neural network (4226) large language model (13587) mixture of expert (640) knowledge distillation (3725) neural network (6616) language model (4599) neural network optimization (1293) efficient computing (781)

Papers

Implicit Feature Decoupling With Depthwise Quantization CVPR 2022
Hyper-Convolution Networks for Biomedical Image Segmentation WACV 2022
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity JMLR 2022
Towards Simple and Efficient Task-Adaptive Pre-training for Text Classification IJCNLP 2022
Unified Scaling Laws for Routed Language Models ICML 2022
Continual Sequence Generation with Adaptive Compositional Modules ACL 2022
Hypoformer: Hybrid Decomposition Transformer for Edge-friendly Neural Machine Translation EMNLP 2022
PLATO-Ad: A Unified Advertisement Text Generation Framework with Multi-Task Prompt Learning EMNLP 2022
Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models EMNLP 2022
Towards Efficient Dialogue Pre-training with Transferable and Interpretable Latent Structure EMNLP 2022
HyperPrompt: Prompt-based Task-Conditioning of Transformers ICML 2022
Parameter-Efficient Sparsity for Large Language Models Fine-Tuning IJCAI 2022
Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models COLING 2022
KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation NAACL 2022
Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models INTERSPEECH 2022
MiniViT: Compressing Vision Transformers With Weight Multiplexing CVPR 2022
Go Wider Instead of Deeper AAAI 2022
Sparse MLP for Image Recognition: Is Self-Attention Really Necessary? AAAI 2022
DEMix Layers: Disentangling Domains for Modular Language Modeling NAACL 2022
Recent Advances in Pre-trained Language Models: Why Do They Work and How Do They Work AACL 2022
NomMer: Nominate Synergistic Context in Vision Transformer for Visual Recognition CVPR 2022
DyRep: Bootstrapping Training With Dynamic Re-Parameterization CVPR 2022
RSTT: Real-Time Spatial Temporal Transformer for Space-Time Video Super-Resolution CVPR 2022
DyConvMixer: Dynamic Convolution Mixer Architecture for Open-Vocabulary Keyword Spotting INTERSPEECH 2022
The State of Sparse Training in Deep Reinforcement Learning ICML 2022