model scaling

Staged Training for Transformer Language Models ICML 2022 Swin Transformer V2: Scaling Up Capacity and Resolution CVPR 2022 Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity JMLR 2022 Using Commonsense Knowledge to Answer Why-Questions EMNLP 2022 Vega-MT: The JD Explore Academy Machine Translation System for WMT22 EMNLP 2022 ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation NeurIPS 2022 What Language Model to Train if You Have One Million GPU Hours? EMNLP 2022 Facebook AI’s WMT21 News Translation Task Submission EMNLP 2021 Fast and Accurate Model Scaling CVPR 2021 GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding ICLR 2021 On Robustness and Transferability of Convolutional Neural Networks CVPR 2021 Revisiting ResNets: Improved Training and Scaling Strategies NeurIPS 2021 Scaling Effect of Self-Supervised Speech Models Interspeech 2021 Scaling Laws for Acoustic Models Interspeech 2021 Searching for Fast Model Families on Datacenter Accelerators CVPR 2021 Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer NeurIPS 2021 You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detection NeurIPS 2021 A Constructive Prediction of the Generalization Error Across Scales ICLR 2020 EfficientDet: Scalable and Efficient Object Detection CVPR 2020 Exploring Transformers for Large-Scale Speech Recognition Interspeech 2020 Neural Machine Translation with Joint Representation AAAI 2020 NeuralScale: Efficient Scaling of Neurons for Resource-Constrained Deep Neural Networks CVPR 2020 CondConv: Conditionally Parameterized Convolutions for Efficient Inference NeurIPS 2019 EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks ICML 2019 The Karlsruhe Institute of Technology Systems for the News Translation Task in WMT 2018 EMNLP 2018