conftrace_

Ivan Ilin

3 papers · 2024–2025 · 2 venues · across top CS/AI venues

Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.

Achievements

Jump to papers ↓

🌍 Conference Polyglot · Bronze 🗺️ Taxonomy Completionist (10)

Venues

NeurIPS (2) NAACL (1)

Top co-authors

Peter Richtarik (3) Vladimir Malinovskii (2) Dan Alistarh (2) Han Guo (1) Konstantin Burlachenko (1) Denis Mazur (1) Andrei Panferov (1) Marta Pozzi (1) Alexander Tyurin (1) Denis Kuznedelev (1)

Research topics

Artificial Intelligence (2) Machine Learning (2) Core AI (2) Deep Learning (1) Application Areas (1) Learning Types (1) Optimization & Theory · Machine Learning (1) Optimization & Theory · Deep Learning (1)

Keywords

neural network optimization (2) large language model (2) model compression (2) asynchronous optimization (1) time complexity (1) gradient compression (1) communication compression (1) distributed stochastic gradient descent (1) straight-through estimator (1) parameter quantization (1) bit-width reduction (1) quantization-aware training (1) hadamard transformation (1) model quantization (1) vector quantization (1)

Papers

HIGGS: Pushing the Limits of Large Language Model Quantization via the Linearity Theorem NAACL 2025 PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression NeurIPS 2024 Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity NeurIPS 2024