conftrace_

model scaling

135 papers

Explore in graph

Co-occurring keywords

large language model (13587) language model (4599) scaling law (120) mixture of expert (640) neural network optimization (1293) vision transformer (1106) transfer learning (5449) neural network (6616) model compression (3302) parameter efficiency (417)

Papers

Transformer verbatim in-context retrieval across time and scale CONLL 2024
Scaling Instruction-Finetuned Language Models JMLR 2024
Are Large Language Model Temporally Grounded? NAACL 2024
Tokenization Falling Short: On Subword Robustness in Large Language Models EMNLP 2024
Tending Towards Stability: Convergence Challenges in Small Language Models EMNLP 2024
Scaling White-Box Transformers for Vision NIPS 2024
LLM Circuit Analyses Are Consistent Across Training and Scale NIPS 2024
Understanding Emergent Abilities of Language Models from the Loss Perspective NIPS 2024
MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts NIPS 2024
When Does Monolingual Data Help Multilingual Translation: The Role of Domain and Model Scale NAACL 2024
Quantifying Association Capabilities of Large Language Models and Its Implications on Privacy Leakage EACL 2024
CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts NIPS 2024
On the Benefits of Learning to Route in Mixture-of-Experts Models EMNLP 2023
YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors CVPR 2023
Scaling Vision-Language Models with Sparse Mixture of Experts EMNLP 2023
Scaling Language-Image Pre-Training via Masking CVPR 2023
Reproducible Scaling Laws for Contrastive Language-Image Learning CVPR 2023
Training Trajectories of Language Models Across Scales ACL 2023
Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages ACL 2023
Model Analysis & Evaluation for Ambiguous Question Answering ACL 2023
Scale Alone Does not Improve Mechanistic Interpretability in Vision Models NIPS 2023
Revisiting Non-Autoregressive Translation at Scale ACL 2023
What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning ACL 2023
To Repeat or Not To Repeat: Insights from Scaling LLM under Token-Crisis NIPS 2023
AI Model Factory: Scaling AI for Industry 4.0 Applications AAAI 2023