conftrace_

model scaling

135 papers

Explore in graph

Co-occurring keywords

large language model (13587) language model (4599) scaling law (120) mixture of expert (640) neural network optimization (1293) vision transformer (1106) transfer learning (5449) neural network (6616) model compression (3302) parameter efficiency (417)

Papers

How Predictable Are Large Language Model Capabilities? A Case Study on BIG-bench EMNLP 2023
MoEC: Mixture of Expert Clusters AAAI 2023
Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Scale ACL 2023
Causes and Cures for Interference in Multilingual Translation ACL 2023
Scaling Vision Transformers to 22 Billion Parameters ICML 2023
TripLe: Revisiting Pretrained Model Reuse and Progressive Learning for Efficient Vision Transformer Scaling and Searching ICCV 2023
Scaling Laws for Multilingual Neural Machine Translation ICML 2023
Boosting Single Image Super-Resolution via Partial Channel Shifting ICCV 2023
Scaling Up Models and Data with t5x and seqio JMLR 2023
RT-1: Robotics Transformer for Real-World Control at Scale RSS 2023
Scaling Law for Document Neural Machine Translation EMNLP 2023
Exploring the Impact of Model Scaling on Parameter-Efficient Tuning EMNLP 2023
Toward Large Kernel Models ICML 2023
Mapping Brains with Language Models: A Survey ACL 2023
SLAMB: Accelerated Large Batch Training with Sparse Communication ICML 2023
Characterizing the Efficiency vs. Accuracy Trade-off for Long-Context NLP Models ACL 2022
Automatic Learning of Subword Dependent Model Scales INTERSPEECH 2022
Staged Training for Transformer Language Models ICML 2022
Scaling ASR Improves Zero and Few Shot Learning INTERSPEECH 2022
Go Wider Instead of Deeper AAAI 2022
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity JMLR 2022
Foundation Models of Scientific Knowledge for Chemistry: Opportunities, Challenges and Lessons Learned ACL 2022
Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models ACL 2022
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing EMNLP 2022
On the Compositional Generalization Gap of In-Context Learning EMNLP 2022