Skip to content
conftrace_
2022 IJCAI IJCAI 2022

Survey on Efficient Training of Large Neural Networks

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Julia Gusak, Daria Cherniuk, Alena Shilova, Alexandr Katrutsa, Daniel Bershatsky, Xunyi Zhao, Lionel Eyraud-Dubois, Oleh Shliazhko, Denis Dimitrov, Ivan Oseledets, Olivier Beaumont

Topics

Machine Learning > Optimization & Theory > Neural Network Optimization Machine Learning > Application Areas > Efficient Computing Deep Learning > Techniques > Model Architecture

Keywords

distributed training memory efficiency gradient checkpointing mixed precision training large language model
Download PDF

More from IJCAI 2022

All IJCAI 2022 papers →
Evidential Reasoning and Learning: a Survey
Legal Judgment Prediction: A Survey of the State of the Art
Who Says What to Whom: A Survey of Multi-Party Conversations
Goal-Conditioned Reinforcement Learning: Problems and Solutions
Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation?
Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Code