Qizhen Zhang
5 papers · 2020–2025 · 4 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+5 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (16) π Interdisciplinary Bridge π§ Keyword Pioneer π Conference Polyglot (4) π Academic Marathon (5)
π
Cross-Pollinator
(14)
π
Renaissance Researcher
(5)
π
Keyword Champion
(2)
π
Trend Setter
β
The Questioner
Conferences
EMNLP (2)
AAAI (1)
ICML (1)
NIPS (1)
Top co-authors
Keywords
mixture of expert
(2)
expert specialization
(2)
attention mechanism
(1)
knowledge transfer
(1)
knowledge distillation
(1)
model merging
(1)
efficient inference
(1)
prior knowledge
(1)
perplexity evaluation
(1)
feature relevance
(1)
inductive bia
(1)
language model
(1)
feed-forward network
(1)
parameter upcycling
(1)
attention weight
(1)
dense model
(1)
continual pretraining
(1)
model initialization
(1)
literature mining
(1)
large language model
(1)
Papers
BTS: Harmonizing Specialized Experts into a Generalist LLM
EMNLP 2025
Nexus: Adaptive Upcycling to Efficiently Pretrain Mixture of Experts
EMNLP 2025
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts
NIPS 2024
PARDEN, Can You Repeat That? Defending against Jailbreaks via Repetition
ICML 2024
Literature Mining for Incorporating Inductive Bias in Biomedical Prediction Tasks (Student Abstract)
AAAI 2020