model scaling

Training Trajectories of Language Models Across Scales ACL 2023 TripLe: Revisiting Pretrained Model Reuse and Progressive Learning for Efficient Vision Transformer Scaling and Searching ICCV 2023 What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning ACL 2023 YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors CVPR 2023 An empirical analysis of compute-optimal large language model training NeurIPS 2022 Automatic Learning of Subword Dependent Model Scales Interspeech 2022 Auto-scaling Vision Transformers without Training ICLR 2022 Characterizing the Efficiency vs. Accuracy Trade-off for Long-Context NLP Models ACL 2022 DF-ResNet: Boosting Speaker Verification Performance with Depth-First Design Interspeech 2022 Do ever larger octopi still amplify reporting biases? Evidence from judgments of typical colour AACL 2022 Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing EMNLP 2022 Exploring the Benefits and Limitations of Multilinguality for Non-autoregressive Machine Translation EMNLP 2022 Exploring the Limits of Large Scale Pre-training ICLR 2022 Foundation Models of Scientific Knowledge for Chemistry: Opportunities, Challenges and Lessons Learned ACL 2022 Go Wider Instead of Deeper AAAI 2022 Lexical Generalization Improves with Larger Models and Longer Training EMNLP 2022 Mixture of Attention Heads: Selecting Attention Heads Per Token EMNLP 2022 Multi-Game Decision Transformers NeurIPS 2022 On the Compositional Generalization Gap of In-Context Learning EMNLP 2022 PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategies NeurIPS 2022 Reversible Vision Transformers CVPR 2022 Scaling ASR Improves Zero and Few Shot Learning Interspeech 2022 Scaling Vision Transformers CVPR 2022 Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models ACL 2022 StableMoE: Stable Routing Strategy for Mixture of Experts ACL 2022