Younes Belkada

3 papers · 2022–2023 · 2 venues · across top CS/AI venues

Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.

Achievements

Jump to papers ↓

🌍 Conference Polyglot · Bronze 🌉 Interdisciplinary Bridge · Bronze 🗺️ Taxonomy Completionist (10)

Venues

NeurIPS (2) ACL (1)

Top co-authors

Tim Dettmers (3) Dmitry Baranchuk (2) Artem Chumachenko (2) Alexander Borzunov (2) Pavel Samygin (2) Luke Zettlemoyer (1) Mike Lewis (1) Colin A Raffel (1) Colin Raffel (1) Maksim Riabinin (1)

Research topics

Machine Learning (3) Artificial Intelligence (2) Deep Learning (2) Core AI (2) Models (2) Optimization & Theory · Machine Learning (2) Mathematics & Optimization (1) Application Areas (1) Learning Types (1) Optimization (1) Optimization & Theory · Deep Learning (1) Techniques (1)

Keywords

large language model (3) distributed learning (1) distributed computing (1) distributed inference (1) collaborative inference (1) parameter-efficient fine-tuning (1) model fine-tuning (1) model offloading (1) matrix multiplication (1) load balancing (1) 8-bit quantization (1) int8 quantization (1) decentralized system (1) model compression (1) mixed-precision decomposition (1)

Papers

Distributed Inference and Fine-tuning of Large Language Models Over The Internet NeurIPS 2023 Petals: Collaborative Inference and Fine-tuning of Large Models ACL 2023 GPT3.int8(): 8-bit Matrix Multiplication for Transformers at Scale NeurIPS 2022