conftrace_

Sihwa Lee

3 papers · 2022–2024 · 3 venues · across top CS/AI venues

Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.

Achievements

Jump to papers ↓

🌍 Conference Polyglot · Bronze 🌉 Interdisciplinary Bridge · Bronze

Venues

ACL (1) EMNLP (1) NeurIPS (1)

Top co-authors

Minsoo Kim (3) Jungwook Choi (3) Du-Seong Chang (2) Wonyong Sung (2) Janghwan Lee (1) Sukjin Hong (1) Suk-Jin Hong (1)

Research topics

Machine Learning (3) Artificial Intelligence (2) Natural Language Processing (2) Application Areas (2) Core AI (2) Resources & Methods (2) Deep Learning (1) Architectures (1) Learning Types (1) Optimization & Theory · Machine Learning (1) Optimization & Theory · Deep Learning (1)

Keywords

knowledge distillation (2) model compression (2) neural network optimization (1) language model (1) parameter-efficient fine-tuning (1) low-rank adaptation (1) transformer encoder (1) quantization-aware training (1) attention recovery (1) model quantization (1)

Papers

RA-LoRA: Rank-Adaptive Parameter-Efficient Fine-Tuning for Accurate 2-bit Quantized Large Language Models ACL 2024 Token-Scaled Logit Distillation for Ternary Weight Generative Language Models NeurIPS 2023 Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders EMNLP 2022