Ze-Feng Gao
8 papers · 2021–2024 · 4 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓
🌍
Conference Polyglot · Bronze
🌉
Interdisciplinary Bridge · Bronze
🗺️
Taxonomy Completionist
(20)
🐣
Hot Topic Early Bird
📈
Trend Setter
Venues
Top co-authors
Research topics
Machine Learning
(8)
Application Areas
(8)
Artificial Intelligence
(6)
Deep Learning
(6)
Core AI
(6)
Optimization & Theory · Deep Learning
(5)
Learning Types
(3)
Architectures
(2)
Models
(2)
Optimization & Theory · Machine Learning
(2)
Natural Language Processing
(1)
Learning Paradigms
(1)
Resources & Methods
(1)
Keywords
model compression
(6)
tensor decomposition
(5)
pre-trained language model
(4)
matrix product operator
(3)
parameter-efficient fine-tuning
(3)
knowledge distillation
(2)
large language model
(2)
neural network optimization
(1)
efficient computing
(1)
parameter sharing
(1)
memory efficiency
(1)
mixture of expert
(1)
feed-forward network
(1)
parameter efficiency
(1)
inference acceleration
(1)
kv cache
(1)
low-bit quantization
(1)
student model
(1)
stable rank
(1)
teacher model
(1)
Papers
Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Study
COLING 2024
Enhancing Parameter-efficient Fine-tuning with Simple Calibration Based on Stable Rank
COLING 2024
Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation
NeurIPS 2024
Unlocking Data-free Low-bit Quantization with Matrix Decomposition for KV Cache Compression
ACL 2024
Enhancing Scalability of Pre-trained Language Models via Efficient Parameter Sharing
EMNLP 2023
Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization
ACL 2023
Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models
COLING 2022
Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators
ACL 2021