Co-occurring keywords · papers mentioning both
Papers
Improving Transformer with an Admixture of Attention Heads
NeurIPS 2022
Instance-Aware Dynamic Neural Network Quantization
CVPR 2022
Learning to Downsample for Segmentation of Ultra-High Resolution Images
ICLR 2022
Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models
EMNLP 2022
LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT
Interspeech 2022
Linearizing Transformer with Key-Value Memory
EMNLP 2022
Lite-MDETR: A Lightweight Multi-Modal Detector
CVPR 2022
LiteTransformerSearch: Training-free Neural Architecture Search for Efficient Language Models
NeurIPS 2022
LittleBird: Efficient Faster & Longer Transformer for Question Answering
EMNLP 2022
Long-range Sequence Modeling with Predictable Sparse Attention
ACL 2022
Look More but Care Less in Video Recognition
NeurIPS 2022
Losses Can Be Blessings: Routing Self-Supervised Speech Representations Towards Efficient Multilingual and Multitask Speech Processing
NeurIPS 2022
Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations
NeurIPS 2022
M³ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design
NeurIPS 2022
MAE-DET: Revisiting Maximum Entropy Principle in Zero-Shot NAS for Efficient Object Detection
ICML 2022
Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the [MASK] Token
EMNLP 2022
MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognition
CVPR 2022
MIA-Former: Efficient and Robust Vision Transformers via Multi-Grained Input-Adaptation
AAAI 2022
MISRNet: Lightweight Neural Vocoder Using Multi-Input Single Shared Residual Blocks
Interspeech 2022
Mobile-Former: Bridging MobileNet and Transformer
CVPR 2022
Modify Self-Attention via Skeleton Decomposition for Effective Point Cloud Transformer
AAAI 2022
Multi Resolution Analysis (MRA) for Approximate Self-Attention
ICML 2022
NASViT: Neural Architecture Search for Efficient Vision Transformers with Gradient Conflict aware Supernet Training
ICLR 2022
Neural Architecture Search for Efficient Uncalibrated Deep Photometric Stereo
WACV 2022
NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Framework
ICML 2022