Yefan Zhou
7 papers · 2023–2024 · 3 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+2 more ↓ Show less ↑
π Conference Polyglot (3) π Interdisciplinary Bridge π§ Keyword Pioneer π Cross-Pollinator (12) πΊοΈ Taxonomy Completionist (12)
π
Keyword Champion
(2)
β‘
Prolific Year
(5)
Conferences
NIPS (3)
EMNLP (2)
ICML (2)
Top co-authors
Keywords
model compression
(3)
heavy-tailed self-regularization
(2)
spectral density
(2)
large language model
(2)
layer-wise learning rate
(2)
neural network optimization
(1)
out-of-distribution generalization
(1)
model pruning
(1)
redundancy reduction
(1)
layer-wise analysis
(1)
hyperparameter tuning
(1)
learning rate
(1)
parameter-efficient fine-tuning
(1)
low-rank adaptation
(1)
mixture of expert
(1)
model fine-tuning
(1)
weight matrix
(1)
layer-wise pruning
(1)
statistical mechanics
(1)
robust generalization
(1)
Papers
Model Balancing Helps Low-data Training and Fine-tuning
EMNLP 2024
AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models
NIPS 2024
Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance
NIPS 2024
AlphaLoRA: Assigning LoRA Experts Based on Layer Training Quality
EMNLP 2024
MD tree: a model-diagnostic tree grown on loss landscape
ICML 2024
Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training
NIPS 2023
A Three-regime Model of Network Pruning
ICML 2023