Ze-Feng Gao
9 papers · 2021–2024 · 5 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+2 more ↓ Show less ↑
π£ Hot Topic Early Bird π Conference Polyglot (5) π Cross-Pollinator (13) π Interdisciplinary Bridge πΊοΈ Taxonomy Completionist (23)
π§
Keyword Pioneer
π
Trend Setter
Conferences
ACL (3)
COLING (3)
EMNLP (1)
IJCNLP (1)
NIPS (1)
Top co-authors
Research topics
Keywords
model compression
(7)
tensor decomposition
(6)
matrix product operator
(4)
pre-trained language model
(4)
parameter efficient fine-tuning
(3)
knowledge distillation
(2)
large language model
(2)
parameter-efficient fine-tuning
(2)
efficient computing
(1)
parameter sharing
(1)
memory efficiency
(1)
mixture of expert
(1)
feed-forward network
(1)
parameter efficiency
(1)
inference acceleration
(1)
kv cache
(1)
low-bit quantization
(1)
pretrained language model
(1)
student model
(1)
stable rank
(1)
Papers
Enhancing Parameter-efficient Fine-tuning with Simple Calibration Based on Stable Rank
COLING 2024
Unlocking Data-free Low-bit Quantization with Matrix Decomposition for KV Cache Compression
ACL 2024
Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation
NIPS 2024
Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Study
COLING 2024
Enhancing Scalability of Pre-trained Language Models via Efficient Parameter Sharing
EMNLP 2023
Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization
ACL 2023
Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models
COLING 2022
Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators
ACL 2021
Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators
IJCNLP 2021